Try our new research platform with insights from 80,000+ expert users

Perfecto vs Ranorex Studio comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Perfecto
Ranking in Functional Testing Tools
11th
Ranking in Mobile App Testing Tools
3rd
Ranking in Test Automation Tools
13th
Average Rating
8.4
Reviews Sentiment
7.9
Number of Reviews
23
Ranking in other categories
Performance Testing Tools (13th)
Ranorex Studio
Ranking in Functional Testing Tools
16th
Ranking in Mobile App Testing Tools
4th
Ranking in Test Automation Tools
12th
Average Rating
8.0
Reviews Sentiment
6.6
Number of Reviews
46
Ranking in other categories
Regression Testing Tools (7th)
 

Mindshare comparison

As of November 2024, in the Functional Testing Tools category, the mindshare of Perfecto is 5.7%, down from 5.8% compared to the previous year. The mindshare of Ranorex Studio is 3.7%, up from 3.1% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Functional Testing Tools
 

Featured Reviews

Roland Castelino - PeerSpot reviewer
Its reporting allows us to have a clear view regarding what tests have been executed
The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature. We leverage Perfecto’s reporting and analytics a lot. From the CI Dashboard, it is mainly the status, which is the past, failure count, and time consumption, e.g., how much time did an average test or script take? Along with that, it provides the historical view compared to the previous result, e.g., am I a pass or fail? Also, the stack trace is very important. Whenever a pass occurs, we don't look beyond that. However, whenever a failure occurs, the stack trace information that it gives us is pretty critical for us when figuring out where failures lie. It gives a summary for the pass/fail count, total test count, the historical view, time consumption for each test as well as the total tests, and the stack rate of the failure. Perfecto's analytics are very important since we use them on a daily basis. We run our executions daily. After every execution, we pull information from the Perfecto reporting system and share that with our stakeholders. Having this information accurately reported is pretty important for us, so everybody is aware of the current status of the product. That way, we can evaluate the health of the product or environment against that which has been executed. Therefore, it helps make those real-time decisions and highlights the impact to the business. I found Perfecto to be pretty easy to use while executing against cross-platforms. The main reason is because the same script or test automation where we execute on multiple platforms has minimal changes that I need to do. Also, it is easy for me to set up an execution on one platform, then on another platform, either in parallel or one after the other. Parallel opportunities save me time. Once the execution has been completed across these different configurations, I can always check and compare, e.g., what are the differences and consistencies? We utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs. I use it occasionally for manual testing. Though, there are other team members who use it more frequently than I do. I use it mainly for executing my automated tests. We have the Perfecto lab, cloud devices, and machines. I can program my test to execute against any of those devices, which gives me more confidence in my product. I can compare and see how my product or application functionally behaves across these different devices and from a UI point of view, which helps me a lot. The device lab is extremely important to our testing operations. We rely on having multiple devices up and running all the time. Whenever we kick off an execution, there are multiple reasons why executions may get triggered: * CodeCommit * A scheduled job. * Might be on-demand by any stakeholder. We need the lab to be available, as we need devices up and running for executions to take place. Also, the devices help since they allow us to have parallel execution, and not just wait for a sequential device to become free and available. Therefore, volume is definitely key. It also gives us an opportunity to compare execution across platforms in that space. It is extremely important to you that the lab provides same-day access to new devices since we analyze that data every single day after execution. Perfecto provides their own framework called Quantum Framework. That is one option. The other option is, if I want to have my own framework, I can have a Java-based Maven project, take a Selenium library, AppiumLibrary, and REST Assured library, and utilize the open-source framework. It is easy for us to connect to Perfecto, no matter what framework we use, as long as it has these core libraries in it. I can design and structure it any way that I want. The execution will happen in Perfecto no matter what since they have support for these tools or libraries. It is pretty neat that way. We are not dependent on using just one particular framework to use Perfecto. While there are still some framework limitations, there is the opportunity to use multiple, different open-source frameworks, then pass the execution to Perfecto. We can use most frameworks, then design and craft it any way that we want, then just pass the execution to Perfecto.
Aws V - PeerSpot reviewer
Good data security, allowing local installations to prevent data from going to the internet
There were a lot of issues we faced. One notable improvement would be better API integration within the tool itself, as we still rely on external tools like Postman. Additionally, expanding language support beyond C#, Java, and JavaScript to include Python would be beneficial. An AI feature that automatically detects automation object properties and suggests actions would be a great addition. So, in future releases, AI solutions for automated property identification would be helpful.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."
"Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot."
"We are continuously doing testing on different environments, devices, and platforms. It executes seamlessly on multiple devices without having any connectivity issues. It has been really helpful for us to test on cloud devices."
"The quality of our software has improved since we implemented this solution."
"It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle."
"The automation piece is the most valuable feature. Every time we had a new version of either OS or an application, we found that being able to automate the testing across different devices is very valuable."
"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."
"The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests."
"The solution is intuitive and pretty self-sustaining. You don't need a lot of help with it in terms of setup or assistance."
"I like the recording function and Ranorex Spy."
"The solution is stable."
"Data security was prime for us. Being able to download and run tests on our local machines was a big plus. The flexibility Ranorex offers in terms of customization is outstanding."
"Support is very quick. You can write to them and on the same day, they will respond. This is one of the best features."
"The scalability is very good. It's probably one of the better tools I've seen on the market."
"The most valuable feature of Ranorex Studio is its user-friendly interface."
"Code Conversion is one of the great features because sometimes, the automation tool doesn't have the capability of maneuvering around two specific evaluations."
 

Cons

"I would like to see the inclusion of machine learning features. If we can have that, it will be a better tool."
"It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."
"There could be some improvements done on the interface. At times, there has been a bit of a struggle when finding things on the interface. A UI revamp would be a better option in future. That UI hasn't changed much in a long time, so I think they could just make it a bit better so that people could find stuff easily and intuitively."
"It would be nice if there were some kind of AI to compile a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature were automated."
"Its performance should be improved. Anything to speed up the user interface would be a great help. We've had a lot of pain with their migration from a product UI that was based on Adobe Flash to the new product that is based on HTML5. Migrations like that seemed to be very painful and not a real smooth process. We're still sort of recovering from that migration from old technology to new, and we haven't got all the functionality ported over that we used to have on the old UI."
"It is slow compared to physical device testing. The interactive speed could be improved."
"We have had some issues with performance, which is something that should be improved."
"I'm hoping they can support on-premises instances. We have been working on a JIRA integration with Perfecto—and I'm extremely impressed that they have that—but at this time they're not supporting onsite JIRA instances, which is what we have."
"Binding to other sources is very good but the object recognition in .NET desktop applications often doesn't work."
"When we have updated the solution in the past there have been issues with the libraries. They need to make it clear that the libraries need to be upgraded too."
"Part of the challenge is that Ranorex's support is over in Europe, so we can't get responses on the same day. If we had support in the United States that was a bit more timely, that would be helpful."
"Ranorex is used in Windows while other solutions, for example, Katalon Studio, are cross-platform. (But in my opinion, overall, Ranorex is better)."
"The solution does not support dual or regression testing."
"We are mainly working for manufacturing OEMs but the integration is not available. It would be a benefit if they built one integration tool for all the Teamcenter home servers and software as the main PLM data source. It is a simple process at this time, the integration could be made easier."
"I'd like to know their testing strategies and to know what they can automate and what they can't. It can become pretty frustrating if you're trying to automate something that changes on a monthly or weekly basis."
"The object detection functionality needs to be improved."
 

Pricing and Cost Advice

"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"This is an expensive solution compared to others, by 30% to 40%."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
"It's definitely on the higher end of prices for this type of service."
"This solution is a more expensive solution compared to some of the other competitors."
"The licensing fees depend on the number of users."
"Our company has one license per user with each costing two lakh rupees."
"We paid €3,000 (approximately $3,300 USD) for this solution. When you add the runtime licenses it will be €3,500 (approximately $3,900 USD)."
"There are several types of licenses and you need to choose depending on your needs and level of usage."
"Licensing fees are paid on a yearly basis."
report
Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
816,406 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
20%
Computer Software Company
17%
Manufacturing Company
9%
Recreational Facilities/Services Company
7%
Computer Software Company
21%
Manufacturing Company
13%
Financial Services Firm
10%
Government
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Perfecto?
Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after eve...
What needs improvement with Perfecto?
It is slow compared to physical device testing. The interactive speed could be improved. And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perf...
What is your primary use case for Perfecto?
We use it for manual mobile testing and a little bit of web testing.
What do you like most about Ranorex Studio?
Data security was prime for us. Being able to download and run tests on our local machines was a big plus. The flexibility Ranorex offers in terms of customization is outstanding.
What is your experience regarding pricing and costs for Ranorex Studio?
I'd rate it around five out of ten, where one is cheap and ten is expensive, not too cheap but not overly pricey.
What needs improvement with Ranorex Studio?
There were a lot of issues we faced. One notable improvement would be better API integration within the tool itself, as we still rely on external tools like Postman. Additionally, expanding languag...
 

Comparisons

 

Also Known As

Perfecto Mobile, Perfecto Web
No data available
 

Learn More

 

Overview

 

Sample Customers

Virgin Media, Paychex, Rabobank, R+V, Discover
Siemens, TomTom, Adidas, Canon, Lufthansa, Roche, Cisco, Philipps, Dell, Motorola, Toshiba, Citrix, Ericsson, sage, Continental, IBM, Credit Suisse, Vodafone
Find out what your peers are saying about Perfecto vs. Ranorex Studio and other solutions. Updated: November 2024.
816,406 professionals have used our research since 2012.