Perfecto vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Perfecto
Ranking in Functional Testing Tools
3rd
Ranking in Test Automation Tools
4th
Average Rating
8.4
Number of Reviews
23
Ranking in other categories
Performance Testing Tools (8th), Mobile App Testing Tools (3rd)
SmartBear TestComplete
Ranking in Functional Testing Tools
10th
Ranking in Test Automation Tools
7th
Average Rating
7.6
Number of Reviews
72
Ranking in other categories
Regression Testing Tools (6th)
 

Market share comparison

As of June 2024, in the Test Automation Tools category, the market share of Perfecto is 2.5% and it decreased by 25.9% compared to the previous year. The market share of SmartBear TestComplete is 5.0% and it decreased by 28.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Automation Tools
Unique Categories:
Performance Testing Tools
0.3%
Functional Testing Tools
6.4%
Regression Testing Tools
8.1%
 

Featured Reviews

reviewer1963857 - PeerSpot reviewer
Sep 18, 2022
The network testing can be accessed from anywhere in the world, but the UI needs revamping
Recently, the network testing component where we can use Perfecto on devices has been the most valuable feature. There is very little competition out there in this regard. We use it for 4G and 5G testing of launched 5G and 4G brands. So, the network testing can be accessed from anywhere in the world. That is very valuable for us. Perfecto is very good when it comes to executing cross-platform testing. We have just gotten started on cross-browser testing. We already use Perfecto for the native-application testing on multiple devices. I think now we also use Perfecto for browser-related testing. So, all the cross-browser testing works well. We got a couple of licenses that we use. We can mostly see usage over time using the device logs. This is what matters the most to us, e.g., what team is using a device for how long. We use Cypress, and it supports it quite well. We use APM, and it also supports that quite well. We used to use the native quantum framework as well in the past, which was obviously well-supported, but now we have moved onto Cypress and APM. Also, we have Applitools, which is not open source, but a paid proprietary tool.
PB
Oct 27, 2023
A UI test automation tool that lets you test every desktop, web, and mobile application
At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced the Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"In terms of cross-platform testing, they offer all of it, every device available in the market. It covers real scenarios that mimic production so that we don't miss out on any devices that our clients might be using to run the applications we develop. It's been great and very helpful."
"Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot."
"The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."
"Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."
"The reporting feature is really tough to find in some of the other products that are competitors. Having your CITB type dashboard, where we can see the test results and see recordings of each test that passed or failed, is probably one of the distinguishing aspects of Perfecto."
"I also like the reporting functions. We are constantly downloading these reports and sharing them with our final customers. They help us understand what kind of bugs are happening through the applications. The recording feature is handy because it lets us see a video of the process we run through the pipeline and discover the point at which the automation is breaking."
"In terms of Perfecto's ability to perform cross-platform testing, I would rate it a ten out of ten."
"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."
"It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows."
"Selenium integration."
"You can record your actions and play them back later."
"The most valuable feature is the integration with Azure DevOps."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
"The ease-of-use and quality of the overall product are above average."
"The most valuable features are the desktop and mobile modules."
"The reporting is ready to use and doesn't require any setup."
 

Cons

"There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools."
"It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."
"It would be nice if there were some kind of AI to compile a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature were automated."
"I would like to see the inclusion of machine learning features. If we can have that, it will be a better tool."
"The monitoring features, in particular network traffic monitoring, could be improved."
"I'm hoping they can support on-premises instances. We have been working on a JIRA integration with Perfecto—and I'm extremely impressed that they have that—but at this time they're not supporting onsite JIRA instances, which is what we have."
"If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us."
"When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"Right now, the product only supports Windows."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"Increased performance with less memory and CPU usage."
"Headless testing would be a big improvement."
"One notable drawback is the absence of native integration with Git."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
 

Pricing and Cost Advice

"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."
"It's definitely on the higher end of prices for this type of service."
"This is an expensive solution compared to others, by 30% to 40%."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
"This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
"It comes with a high cost."
"It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools."
"Overall, for us, the cost of the TestComplete platform and the three extra modules is around $8,000."
"My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
"It is approximately $6,000 a year."
"The pricing is pretty reasonable."
"The pricing is a little above average — it could be lower."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
787,061 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
18%
Manufacturing Company
8%
Recreational Facilities/Services Company
7%
Computer Software Company
19%
Manufacturing Company
12%
Financial Services Firm
12%
Government
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Perfecto?
Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after eve...
What is your experience regarding pricing and costs for Perfecto?
Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discoun...
What needs improvement with Perfecto?
It is slow compared to physical device testing. The interactive speed could be improved. And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perf...
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
It's comparable to other similar tools, perhaps a bit less expensive than some of its competitors. So, the pricing is pretty reasonable.
What needs improvement with SmartBear TestComplete?
Headless testing would be a big improvement. For example, when we run our regression suite, we need to start a virtual machine and run the tests interactively. There isn't a way to run the tests he...
 

Also Known As

Perfecto Mobile, Perfecto Web
No data available
 

Overview

 

Sample Customers

Virgin Media, Paychex, Rabobank, R+V, Discover
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about Perfecto vs. SmartBear TestComplete and other solutions. Updated: May 2024.
787,061 professionals have used our research since 2012.