Try our new research platform with insights from 80,000+ expert users

Sauce Labs vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Sauce Labs
Ranking in Functional Testing Tools
12th
Ranking in Test Automation Tools
15th
Average Rating
8.8
Number of Reviews
113
Ranking in other categories
No ranking in other categories
SmartBear TestComplete
Ranking in Functional Testing Tools
7th
Ranking in Test Automation Tools
6th
Average Rating
7.6
Reviews Sentiment
7.3
Number of Reviews
75
Ranking in other categories
Regression Testing Tools (5th)
 

Mindshare comparison

As of November 2024, in the Test Automation Tools category, the mindshare of Sauce Labs is 3.2%, down from 5.1% compared to the previous year. The mindshare of SmartBear TestComplete is 6.5%, down from 7.9% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Automation Tools
 

Featured Reviews

Savio De Souza - PeerSpot reviewer
Enables us to have a fully functional CI/CD process while saving time and cutting down on the training required for individual testers
When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched. We got around that by purchasing more seats, tinkering with some of the virtualization pieces, and scaling. Now we don't have that issue, because we scaled back the offshore team significantly, so when we run it overnight, there's really no effect. We come in the next morning and review the results. It doesn't affect the overall business or the offshore team. There were also some bottlenecks because of the amount of time testing takes, so we started using more tunnels and running it in parallel. That was the main issue that we faced initially, but now that it's all set up, we're good to go. We were struggling with the volume of tests, and Sauce Labs suggested we run everything in parallel. Sauce Labs isn't lacking any features that we want, and it has several we're not using, like mobile and API testing. They've also introduced a ton more features since we launched, so I don't see anything missing on their end.
Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable feature is cross-browser, cross-OS, cross-mobile device testing."
"Testing my app on cloud has really helped us with save time and resources to procure various hardware and software, and set those up."
"APPIUM for mobile testing has improved our organization by allowing us to test our website on more devices and browsers than we currently possess."
"It offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline."
"So far, the stability has proven to be quite good."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"The Failure Analysis feature is really important for us, one of the most important aspects. What is the root cause? Is it because we have a defect or is it that we have a test case that we need to fix or modify? The Failure Analysis is one of the main functionalities that I am exploring all the time in Sauce Labs... The Failure Analysis helps us to discover which test cases we need to work on."
"Sauce Connect gave us ability to test an application that was hosted locally."
"When compared to other tools, it is very simple."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"The ease-of-use and quality of the overall product are above average."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"It is a strong automation tool for desktop, browser, and API testing."
 

Cons

"Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended."
"There have been various times throughout the last month or so where the service has gone down during business hours."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"We have faced challenges with the availability of mobile devices. There was once or twice where there were no mobile devices available."
"The ability to install profiles on iOS real mobile devices should be included."
"The initial setup of SmartBear TestComplete was complex."
"One notable drawback is the absence of native integration with Git."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"The artificial intelligence needs to be improved."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"The solution’s customer support should be improved."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"Product is not stable enough and it crashes often."
 

Pricing and Cost Advice

"Trial the product and see if it suits your needs."
"The pricing is definitely on the higher end, and there are other options that are more cost-effective."
"The pricing is reasonable due to the amount of diversity that they provide. However, I feel they might be more flexible to bargain based on their relationship with our organization."
"Cost-wise, it's decent. If you have to get the base version out of it, it's the best solution to go with. As compared to other cloud service providers, the pricing of Sauce Labs is decent."
"Compared with other services, Sauce Labs is a bit expensive."
"Their pricing is incredibly competitive."
"We pay for a specific number of VMs."
"We have an enterprise account; it has worked great for our needs."
"It is approximately $6,000 a year."
"We have a TestComplete 12 license."
"Our ROI is about $10,000 a year."
"The price is less, compared to other products, such as QTP."
"Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
"The solution is around $1500. Some are perpetual licenses, and some get a yearly report card."
"The price of SmartBear TestComplete could be less. The main challenge is when it comes to node-locked. They should use a subscription model, such as a monthly-based subscription or, a quarterly-based subscription. Their floating license is very expensive, and this high price should be reduced or provide, at a minimum, a subscription model."
"It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
816,406 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
18%
Computer Software Company
17%
Manufacturing Company
6%
Healthcare Company
6%
Computer Software Company
19%
Manufacturing Company
13%
Financial Services Firm
12%
Government
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Sauce Labs?
It has significantly enhanced our testing accuracy by approximately 50%.
What needs improvement with Sauce Labs?
Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. For example, in my current project, we reduced the time it took to complete user...
What is your primary use case for Sauce Labs?
I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java. I have also worked with Docker integration on AWS. Additionally, I have experie...
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
The solution's pricing is too high. On a scale from one to ten, where one is cheap and ten is expensive, I rate the solution's pricing nine and a half out of ten.
What needs improvement with SmartBear TestComplete?
The learning curve of the solution's user interface is a little high for new users.
 

Overview

 

Sample Customers

Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about Sauce Labs vs. SmartBear TestComplete and other solutions. Updated: November 2024.
816,406 professionals have used our research since 2012.