Sauce Labs vs SmartBear TestComplete comparison

Cancel
You must select at least 2 products to compare!
Sauce Labs Logo
3,866 views|2,901 comparisons
96% willing to recommend
SmartBear Logo
6,927 views|4,860 comparisons
86% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Sauce Labs and SmartBear TestComplete based on real PeerSpot user reviews.

Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Sauce Labs vs. SmartBear TestComplete Report (Updated: May 2024).
772,649 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for.""As stated earlier we use Sauce Labs for a combination of automated testing and manual testing. Therefore the most useful features are the ability to run the functional automated tests via a Sauce Labs tunnels which allows access to applications in our internal network. The second most useful feature is the manual side.""Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements.""The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should.""Testing subscription videos for on-demand software, making them better quality and bug free for our customers.""It has a wide assortment of platforms.""They update for the latest browsers and mobile phones and support a lot of combinations. They have 1,000-plus desktop combinations and browser versions, which is really great. We need that at Applause. The all-in-one testing suite aspect of it is really important because most of our clients prefer to go to one place.""Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."

More Sauce Labs Pros →

"You can record your actions and play them back later.""The solution is mainly stable.""The solution is great as a record and playback tool. It also has valuable regression testing.""The product is stable for what we are currently using it for, and it is sufficient for us.""In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great.""The product has many features.""This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to assign tags to your test cases. When there's an impact in a specific area, you can search for and run all test cases associated with that tag. I find this functionality very useful.""I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."

More SmartBear TestComplete Pros →

Cons
"An image comparison would be a nice feature to include in the Sauce Labs product.""I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management.""Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so.""Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code.""It should provide more examples of script code.""On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues.""Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot.""The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."

More Sauce Labs Cons →

"Error handling features in the tool are a little limited.""Headless testing would be a big improvement.""What is currently missing from this solution is better support for mobile testing.""The licensing costs are a little bit high and should be reduced.""If that engine could better identify more XPaths automatically and make the process more flexible, that would be better.""Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work.""The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS.""One notable drawback is the absence of native integration with Git."

More SmartBear TestComplete Cons →

Pricing and Cost Advice
  • "We have an enterprise account; it has worked great for our needs."
  • "Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."
  • "It could be less like pay-per-use with a lower rate."
  • "Go ahead please. Try it at a smaller scale."
  • "Trial the product and see if it suits your needs."
  • "When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
  • "Compared with other services, Sauce Labs is a bit expensive."
  • "​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
  • More Sauce Labs Pricing and Cost Advice →

  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
    772,649 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:It has significantly enhanced our testing accuracy by approximately 50%.
    Top Answer:They could improve the platform's customer support services. Many users, including myself, have experienced significant delays in response times and unsatisfactory resolutions when reaching out for… more »
    Top Answer:Our primary use case for Sauce Labs involves running automated test cases for our web application. It works as a remote testing environment to execute these test cases efficiently and effectively.
    Top Answer:TestComplete has strong reporting capabilities. The reports they generate are really good.
    Top Answer:It's comparable to other similar tools, perhaps a bit less expensive than some of its competitors. So, the pricing is pretty reasonable.
    Top Answer:Headless testing would be a big improvement. For example, when we run our regression suite, we need to start a virtual machine and run the tests interactively. There isn't a way to run the tests… more »
    Ranking
    13th
    Views
    3,866
    Comparisons
    2,901
    Reviews
    2
    Average Words per Review
    1,551
    Rating
    5.5
    7th
    Views
    6,927
    Comparisons
    4,860
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    Comparisons
    Learn More
    Overview

    Sauce Labs is a functional testing tool that ensures your apps and websites work flawlessly on every browser, OS, and device. The solution allows you to automate functional testing on multiple operating systems and browsers, emulating the way that a user would use the website. With Sauce Labs, you can also run tests on various operating system and browser combinations in parallel, reducing the amount of time to get results. The Sauce Labs solution provides enterprise-grade security, scalability, and reliability.

    Sauce Labs Features

    Sauce Labs has many valuable key features. Some of the most useful ones include:

    • Automated cross-browser testing
    • Mobile testing
    • Secure tunneling protocol
    • Usage reporting
    • Enterprise security
    • Provisioning
    • Centralized user account management
    • Access controls
    • Support for Selenium, Appium, and JUnit Testing

    Sauce Labs Benefits

    There are many benefits to implementing Sauce Labs. Some of the biggest advantages the solution offers include:

    • Speed up development time: The solution makes it possible for you to test web and mobile apps in parallel and accelerate your testing time by up to 10x or more. Using Sauce Labs, you can increase developer productivity because your teams will be able to spend less time with test maintenance and debug faster.
    • No worrying about infrastructure: With Sauce Labs, you don’t have to buy or maintain more servers or mobile devices. You also don’t need to worry about updating browsers or VM licenses. Sauce Labs allows you to easily scale your tests with parallelization to speed up test cycles and boost capacity on their reliable cloud.
    • Run tests securely: The solution enables you to securely run your scripts and access your data and files from behind your firewall. Sauce Labs generates single-use VMs for every test and destroys them immediately afterwards so your data always remains secure.
    • Easy integration for your CI systems: Sauce Labs automated testing platform integrates with Jenkins, Bamboo, Microsoft VSTS, and others so you can test as fast as you develop. In addition, you can share results instantly by using the solution’s simple plugins.

    Reviews from Real Users

    Sauce Labs is a solution that stands out when compared to many of its competitors. It has valuable features that include error logging, helpful dashboards, and its browser.

    Joel A., Product Manager - Data & APIs at a marketing services firm, says, "The error logging is very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."

    Savio D., Sr. IT Architect at a healthcare company, mentions, "Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."

    PeerSpot reviewer, Rob L., Director of Quality Assurance - Shared Service at a financial services firm, writes, “The most valuable feature for us is the browser. The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.”

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Sample Customers
    Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Top Industries
    REVIEWERS
    Healthcare Company14%
    Computer Software Company11%
    Media Company9%
    Retailer8%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Healthcare Company6%
    Retailer6%
    REVIEWERS
    Computer Software Company33%
    Manufacturing Company12%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Manufacturing Company12%
    Financial Services Firm11%
    Government7%
    Company Size
    REVIEWERS
    Small Business25%
    Midsize Enterprise20%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise11%
    Large Enterprise71%
    REVIEWERS
    Small Business29%
    Midsize Enterprise27%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise15%
    Large Enterprise61%
    Buyer's Guide
    Sauce Labs vs. SmartBear TestComplete
    May 2024
    Find out what your peers are saying about Sauce Labs vs. SmartBear TestComplete and other solutions. Updated: May 2024.
    772,649 professionals have used our research since 2012.

    Sauce Labs is ranked 13th in Test Automation Tools with 113 reviews while SmartBear TestComplete is ranked 7th in Test Automation Tools with 72 reviews. Sauce Labs is rated 8.8, while SmartBear TestComplete is rated 7.6. The top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, Bitbar and Tricentis Tosca, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish. See our Sauce Labs vs. SmartBear TestComplete report.

    See our list of best Test Automation Tools vendors, best Functional Testing Tools vendors, and best Regression Testing Tools vendors.

    We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.