Try our new research platform with insights from 80,000+ expert users

Sauce Labs vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 15, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Sauce Labs
Ranking in Functional Testing Tools
10th
Ranking in Test Automation Tools
15th
Average Rating
8.8
Reviews Sentiment
7.2
Number of Reviews
113
Ranking in other categories
No ranking in other categories
SmartBear TestComplete
Ranking in Functional Testing Tools
7th
Ranking in Test Automation Tools
6th
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
75
Ranking in other categories
Regression Testing Tools (5th)
 

Mindshare comparison

As of January 2025, in the Test Automation Tools category, the mindshare of Sauce Labs is 3.1%, down from 4.9% compared to the previous year. The mindshare of SmartBear TestComplete is 6.2%, down from 7.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Automation Tools
 

Featured Reviews

Joel Alonzo - PeerSpot reviewer
Metrics about testing across the company are easily accessible, and it's easy to get teams up and running
Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot. The other issue is that when you're behind a corporate proxy and inside a corporate network, it's a nightmare in general. And the problem that we've come up against over and over again is that a lot of our network staff don't want to open up giant CIDR blocks to internal traffic. Opening it up to one endpoint which is Sauce Labs, through a little API is perfectly fine. That's one IP address and it's no big deal. But for their virtual machines they have one jump box and that jump box contains an entire CIDR block that changes each time the tunnel starts up. In other words, if every call went into one IP and that got bounced back to a load balancer or net gateway, that would help a lot too. When I go to the network team and say, "Hey, we're using a product, a piece of software, and I need an entire CIDR block opened," the first and almost eternal response to that will be "absolutely not." Getting things set up and running is always going to be a bit of a struggle within any corporate environment. Most of that is not Sauce Labs' fault, but the things I just mentioned are things they could do to help deal with that struggle.
Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"With only a few clicks, it gives us the availability to use any browser and OS combination whenever we want."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them."
"They update for the latest browsers and mobile phones and support a lot of combinations. They have 1,000-plus desktop combinations and browser versions, which is really great. We need that at Applause. The all-in-one testing suite aspect of it is really important because most of our clients prefer to go to one place."
"I never faced any issues with the stability."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The solution has a very nice interface."
"Selenium integration."
"The most valuable feature of this solution is regression testing tools."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts."
"The integration with various tools is important."
"The solution is mainly stable."
 

Cons

"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"They could improve the platform's customer support services."
"Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point."
"I may not know what should be improved on the platform, but I think it could offer a greater variety of testing solutions. I know there might be competing solutions that cover more things I'm unaware of, and it could expand a bit more. We've done a lot of automated testing scenarios, and that's all the rage these days, so I think Sauce Labs could look at potential ways to improve and cover other scenarios."
"Running tests in the SauceCloud can take longer than running in a local environment."
"An image comparison would be a nice feature to include in the Sauce Labs product."
"Lacks the ability to start multiple tests simultaneously."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail."
"If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
"The recording function, when using Python, could be improved, as it does not work well in recording testing."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"To bring it up to a 10, I would be looking for the addition of some key functional API testing."
 

Pricing and Cost Advice

"We pay for a specific number of VMs."
"Cost-wise, it's decent. If you have to get the base version out of it, it's the best solution to go with. As compared to other cloud service providers, the pricing of Sauce Labs is decent."
"The number of concurrent VMs that Sauce Labs provides depends on your purchase license level."
"The pricing is reasonable due to the amount of diversity that they provide. However, I feel they might be more flexible to bargain based on their relationship with our organization."
"Trial the product and see if it suits your needs."
"Their pricing is incredibly competitive."
"The pricing is definitely on the higher end, and there are other options that are more cost-effective."
"We did initially go with Sauce Labs because of the pricing and integration."
"The price of SmartBear TestComplete could be less. The main challenge is when it comes to node-locked. They should use a subscription model, such as a monthly-based subscription or, a quarterly-based subscription. Their floating license is very expensive, and this high price should be reduced or provide, at a minimum, a subscription model."
"It comes with a high cost."
"It is approximately $6,000 a year."
"Our ROI is about $10,000 a year."
"The price is less, compared to other products, such as QTP."
"We have a TestComplete 12 license."
"The pricing is a little above average — it could be lower."
"The pricing is pretty reasonable."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
831,158 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
15%
Manufacturing Company
6%
Retailer
6%
Computer Software Company
19%
Manufacturing Company
13%
Financial Services Firm
12%
Government
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Sauce Labs?
It has significantly enhanced our testing accuracy by approximately 50%.
What needs improvement with Sauce Labs?
Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. For example, in my current project, we reduced the time it took to complete user...
What is your primary use case for Sauce Labs?
I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java. I have also worked with Docker integration on AWS. Additionally, I have experie...
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I don't know much about the pricing, however, I think it's cheaper.
What needs improvement with SmartBear TestComplete?
The recording function, when using Python, could be improved, as it does not work well in recording testing.
 

Overview

 

Sample Customers

Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about Sauce Labs vs. SmartBear TestComplete and other solutions. Updated: December 2024.
831,158 professionals have used our research since 2012.