Perfecto vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Perfecto
Ranking in Functional Testing Tools
3rd
Ranking in Test Automation Tools
4th
Average Rating
8.4
Number of Reviews
23
Ranking in other categories
Performance Testing Tools (8th), Mobile App Testing Tools (3rd)
SmartBear TestComplete
Ranking in Functional Testing Tools
10th
Ranking in Test Automation Tools
7th
Average Rating
7.6
Number of Reviews
72
Ranking in other categories
Regression Testing Tools (6th)
 

Market share comparison

As of June 2024, in the Test Automation Tools category, the market share of Perfecto is 2.5% and it decreased by 25.9% compared to the previous year. The market share of SmartBear TestComplete is 5.0% and it decreased by 28.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Automation Tools
Unique Categories:
Performance Testing Tools
0.3%
Functional Testing Tools
6.4%
Regression Testing Tools
8.1%
 

Featured Reviews

FA
Aug 4, 2022
We've been able to get our testing done a lot faster, and multiple devices means manual testing is not delayed
We've been able to automate test cases that are mobile-related. That's helping a lot with our automation. Obviously, you can't automate on a physical device, it's something that we do on a virtual machine. The fact that we can automate on mobile, Android and iOS, is working well for us. We use the CI Dashboard. Perfecto's analytics are very important because that is where we have our test results, which we later input into Jira as well. We use the device lab in our testing operations and mobile is one of the things we use. We have multiple devices, about 20, including Android and iOS. That's what we are running our automated test cases on. The device lab is extremely important because we are doing our automatic test cases and even our manual testing there. We don't have physical devices. We go into the Perfecto website and use all the mobile devices available on the cloud. Also, we're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us. We are mostly using Selenium and we are slowly putting our hands on Appium as well. That's working out well for us too.
PB
Oct 27, 2023
A UI test automation tool that lets you test every desktop, web, and mobile application
At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced the Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle."
"Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."
"One of the good things about Perfecto is the scalability that it provides."
"It creates a faster production cycle and is quick to market. Things get deployed earlier because the testing happens on time. We can do a lot of panelization, so a lot of test phases can happen in a panel. People don't have to wait for a device to come to them. They can access multiple devices at the same time and do testing at the same time."
"The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."
"In terms of Perfecto's ability to perform cross-platform testing, I would rate it a ten out of ten."
"The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."
"The most valuable feature is automated testing."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
"Customer service and technical support responsiveness are high. Everyone is very professional."
"It allows us to test both desktop and web applications."
"TestComplete is simple, it's a very easy-to-use tool."
"TestComplete has strong reporting capabilities. The reports they generate are really good."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"The ease-of-use and quality of the overall product are above average."
 

Cons

"If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us."
"We don't use Perforce's BlazeMeter with Perfecto. From my perspective, it's not really relevant."
"Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us."
"Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making."
"It would be nice if there were some kind of AI to compile a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature were automated."
"When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good."
"I would like to see the inclusion of machine learning features. If we can have that, it will be a better tool."
"Its performance should be improved. Anything to speed up the user interface would be a great help. We've had a lot of pain with their migration from a product UI that was based on Adobe Flash to the new product that is based on HTML5. Migrations like that seemed to be very painful and not a real smooth process. We're still sort of recovering from that migration from old technology to new, and we haven't got all the functionality ported over that we used to have on the old UI."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"Product is not stable enough and it crashes often."
"The pricing is the constraint."
"Increased performance with less memory and CPU usage."
"The integration tools could be better."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
 

Pricing and Cost Advice

"This is an expensive solution compared to others, by 30% to 40%."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"It's definitely on the higher end of prices for this type of service."
"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
"The price of SmartBear TestComplete could be less. The main challenge is when it comes to node-locked. They should use a subscription model, such as a monthly-based subscription or, a quarterly-based subscription. Their floating license is very expensive, and this high price should be reduced or provide, at a minimum, a subscription model."
"The price is less, compared to other products, such as QTP."
"The pricing is pretty reasonable."
"We have a TestComplete 12 license."
"The license price for a physical machine is cheap, and for virtual machine, it is very expensive."
"TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
"It comes with a high cost."
"Our ROI is about $10,000 a year."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
787,061 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
17%
Manufacturing Company
8%
Recreational Facilities/Services Company
7%
Computer Software Company
19%
Manufacturing Company
12%
Financial Services Firm
12%
Government
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Perfecto?
Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after eve...
What is your experience regarding pricing and costs for Perfecto?
Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discoun...
What needs improvement with Perfecto?
It is slow compared to physical device testing. The interactive speed could be improved. And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perf...
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
It's comparable to other similar tools, perhaps a bit less expensive than some of its competitors. So, the pricing is pretty reasonable.
What needs improvement with SmartBear TestComplete?
Headless testing would be a big improvement. For example, when we run our regression suite, we need to start a virtual machine and run the tests interactively. There isn't a way to run the tests he...
 

Also Known As

Perfecto Mobile, Perfecto Web
No data available
 

Overview

 

Sample Customers

Virgin Media, Paychex, Rabobank, R+V, Discover
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about Perfecto vs. SmartBear TestComplete and other solutions. Updated: May 2024.
787,061 professionals have used our research since 2012.