Katalon Studio vs Sauce Labs vs Tricentis Tosca comparison

Katalon Studio and Sauce Labs are both solutions in the Test Automation Tools category. Katalon Studio is ranked #3 with an average rating of 7.4, while Sauce Labs is ranked #15 with an average rating of 6.0. Katalon Studio holds a 11.6% mindshare in TAt, compared to Sauce Labs’s 3.2% mindshare. Additionally, 88% of Katalon Studio users are willing to recommend the solution, compared to 96% of Sauce Labs users who would recommend it.

Katalon Studio

Read 43 Katalon Studio reviews

8,973 Views
6,176 Comparison Views

88% willing to recommend

Sauce Labs

Read 113 Sauce Labs reviews

2,965 Views
2,294 Comparison Views

96% willing to recommend

Tricentis Tosca

Read 107 Tricentis Tosca reviews

20,715 Views
10,860 Comparison Views

96% willing to recommend

Katalon Studio

Sauce Labs

Tricentis Tosca

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Katalon Studio, Sauce Labs, and Tricentis Tosca based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools.

To learn more, read our detailed Test Automation Tools Report (Updated: October 2024).

Buyer's Guide

Test Automation Tools

October 2024

Download the complete report

Helped 814,895 peers since 2012

Mindshare comparison

As of November 2024, in the Test Automation Tools category, the mindshare of Katalon Studio is 11.6%, up from 11.7% compared to the previous year. The mindshare of Sauce Labs is 3.2%, down from 5.1% compared to the previous year. The mindshare of Tricentis Tosca is 22.5%, up from 18.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Test Automation Tools

Featured Reviews

Anuradha.Kapoor Kapoor

Head - Quality Control at Net Solutions

May 15, 2024

Functional automation features and the recording functionality saves time but the performance and script execution is slow

I would like to see improvements in how Katalon Studio works with iOS applications, especially with React Native applications. The speed is very slow. It takes time. Katalon Studio also takes my laptop memory, and execution becomes slow for the script. There are parallel execution options. I'm sure their online cloud version must be very fast, but as a service-based company, we are under NDA with our clients and can't run their code on our servers. I would like to see iOS improve and see a more capable recording feature. Katalon Studio has released an AI version, and I have a demo scheduled to see the new features.

Read full review

Savio De Souza

Sr. IT Architect at a healthcare company with 10,001+ employees

Feb 15, 2022

Enables us to have a fully functional CI/CD process while saving time and cutting down on the training required for individual testers

When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched. We got around that by purchasing more seats, tinkering with some of the virtualization pieces, and scaling. Now we don't have that issue, because we scaled back the offshore team significantly, so when we run it overnight, there's really no effect. We come in the next morning and review the results. It doesn't affect the overall business or the offshore team. There were also some bottlenecks because of the amount of time testing takes, so we started using more tunnels and running it in parallel. That was the main issue that we faced initially, but now that it's all set up, we're good to go. We were struggling with the volume of tests, and Sauce Labs suggested we run everything in parallel. Sauce Labs isn't lacking any features that we want, and it has several we're not using, like mobile and API testing. They've also introduced a ton more features since we launched, so I don't see anything missing on their end.

Read full review

Antonio Oteri

Supplier in ATOS for TIM Brasil at TIM

Sep 3, 2024

Ability to automate tests across various platforms and simplifies test creation

From what I've seen with my colleagues who make the software selection, the prices for this software in Brazil are too expensive to be applied to anything but huge customers. I'm surprised because I was in charge of planning and control at the company before, when there was a manager there. Normally, the company has structural licenses that are based on the company they are selling to. I see that these companies cannot spend this money on Tricentis. I think Tosca is losing this type of market. They should have a different license policy for medium and small companies. The same happened in the past with SAP, which changed its policy and also made licenses for low.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"Smart Wait and XPath healing are valuable features."

"The most valuable feature of Katalon Studio is the ease of use of the solution."

"The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful."

"The automation is very fast and you don't need to be overly proficient in coding."

"The most valuable feature of Katalon Studio is that everything can be managed from one platform."

"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."

"I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy."

"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."

More Katalon Studio pros

"The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."

"It provides zero maintenance browser instances."

"So far, the stability has proven to be quite good."

"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."

"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."

"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."

"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."

"Sauce Connect gave us ability to test an application that was hosted locally."

More Sauce Labs pros

"We like the fact that it works across mobile, desktop, web, and APIs. Due to this, the solution has a broad range of applications."

"This tool is very easy to use and I think that anyone can come in, having no experience with it, and within four to six months be comfortable with it."

"One notable feature is its ability to handle negative XPath healing processes. If one XPath fails, Tosca can utilize backup XPaths to ensure test cases do not fail due to locator issues, thereby focusing on identifying application-side issues, which is the ultimate goal."

"The platform's most valuable feature is model-based testing, which is effective for test case design and optimization."

"This tool has test data management capability along with test management."

"The tool's most valuable feature is Tosca Commander."

"It has helped teams within our organization become more aware of the testing requirements in terms of risk and priority."

"The solution has plenty of features compared to other solutions."

More Tricentis Tosca pros

Cons

"Now we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time."

"There is not much support offered for the free version, which is something that could be improved."

"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."

"What it lacks is the Selenium Grid capabilities."

"Support options need improvement. It is sometimes hard to find a solution to any given problem, thus you are forced to use another solution."

"It would be helpful if they can integrate a feature for performance testing."

"I've seen that our clients are not truly aware of the power behind Katalon."

"It should start working on Silverlight automation."

More Katalon Studio cons

"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."

"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."

"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm"

"The ability to install profiles on iOS real mobile devices should be included."

"They could improve the platform's customer support services."

"Integration with Github, as well as several other similar tools, could be improved."

"Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so."

"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."

More Sauce Labs cons

"Tricentis Tosca could improve on the ease of use. There is a steep learning curve. The reporting section could be better and some of the new features could be simplified. Additionally, the user management of the client and the server are confusing. There should not be two."

"Security, UI, and basic performance improvements could be done to the product to enhance its use."

"The source controls that are in Tricentis Tosca have some problems. For example, if you use Selenium or use Java-based application, it's easy to match code from two developers. However, if you're a developer and going to look at Tricentis Tosca, it's very difficult to use the source control measure."

"More and more artificial intelligence (AI) is coming in. So, some amount of AI to create natural language processing (NLP)-based test cases and manage defects would be very helpful. This is because the technologies have evolved in the last five to six months, so there is a potential opportunity there."

"I would like a better user interface."

"The Test Management options are still weak - improvement is outlined, but not yet visible. I"

"The main area where there is room for improvement is how they do upgrades. Going through this current upgrade, we were delayed a month because we are using a third-party tool. It's called Tosca Connect by Tasktop. When this latest upgrade broke that relationship between the two, it took Tricentis a month to come back with a workable solution... Their whole upgrade process needs to be better and cleaner, from an end-user standpoint."

"Many times when we have raised a ticket, we did not get an urgent response."

More Tricentis Tosca cons

Pricing and Cost Advice

"We are using the free version of Katalon Studio at this point."

"We are using the free version. We plan on getting a paid version because there is a limitation in terms of the number of users. We want to maximize it."

"Katalon Studio is a free tool."

"The product’s pricing is very, very low."

"The cost of Katalon Studio is expensive but it is less than some of the other solutions, such as Micro Focus UFT or SmartBear TestComplete. The cost is the main reason we are using Katalon Studio."

"The product is affordable. It has an average and competitive pricing compared to other vendors."

"There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well."

"The tool's licensing costs are yearly."

More Katalon Studio pricing and cost advice

"Trial the product and see if it suits your needs."

"Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."

"We did initially go with Sauce Labs because of the pricing and integration."

"They could improve on the pricing because it seems pretty expensive. I'm sure it's justified, but it's expensive."

"The pricing is reasonable due to the amount of diversity that they provide. However, I feel they might be more flexible to bargain based on their relationship with our organization."

"Go ahead please. Try it at a smaller scale."

"Compared with other services, Sauce Labs is a bit expensive."

"When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."

More Sauce Labs pricing and cost advice

"Tricentis Tosca is an expensive tool and the licensing is not simple."

"Tosca is expensive. I don't see small and medium customers going for it. It's always large enterprises that have a big pocket. It is very expensive as compared to the other tools that we have in the market. They should reduce the price by half, and if they do that, they would do better business. From the competition perspective, other solutions are at a pretty similar level. UiPath is also very expensive. One thing that I always wanted was a short-term consumption license. With Tricentis, the biggest challenge is that you have to go for a minimum of one year license, and they also try to sell you a three-year license. It would be good if people can get a three-month or four-month consumption license."

"Although the product is slightly more expensive than tools, its automation capabilities and reduced scripting needs justify the cost."

"There are two licenses: single user and multiple user. A multiple-user license means that several people can work together on one project and collaborate on code stored in a central location. A single-user license is for people working alone on a one particular application. It's much cheaper than a multi-user workspace. If you are getting a large volume of licenses for an enterprise, you can probably negotiate a discount, but I'm not sure about that."

"Tricentis Tosca is not expensive at all."

"Tricentis Tosca may be relatively on the higher side in terms of pricing, but their sales rep can give pretty decent deals when asked."

"I rate the price of Tricentis Tosca a two out of five."

"We have around 200 [concurrent] licenses and the cost around $1.4 million a year."

More Tricentis Tosca pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.

See recommendations

814,895 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Educational Organization

31%

Computer Software Company

14%

Financial Services Firm

10%

Manufacturing Company

Financial Services Firm

19%

Computer Software Company

16%

Manufacturing Company

Healthcare Company

Computer Software Company

14%

Manufacturing Company

13%

Financial Services Firm

13%

Insurance Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

What do you like most about Katalon Studio?

The solution is easy to learn.

See all answers

What is your experience regarding pricing and costs for Katalon Studio?

We have a combination of both paid and free licenses. We have five licenses, and we are in the process of buying six ...

See all answers

What needs improvement with Katalon Studio?

There could be many improvements, however, I have not noted them down at this moment.

See all answers

What do you like most about Sauce Labs?

It has significantly enhanced our testing accuracy by approximately 50%.

See all answers

What needs improvement with Sauce Labs?

Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. ...

See all answers

What is your primary use case for Sauce Labs?

I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java....

See all answers

How does Micro Focus UFT One compare to Tricentis Tosca?

We reviewed MicroFocus UFT One but ultimately chose to use Tricentis Tosca because we needed API testing. MicroFocus...

See all answers

How does Tricentis Tosca compare with Worksoft Certify?

Tosca fulfills our business needs better because it is an end-to-end solution across technologies. We like that it is...

See all answers

What do you like most about Tricentis Tosca?

For beginners, the product is good, especially for those who are interested in the quality side of software testing.

See all answers

Comparisons

OpenText UFT One vs Katalon Studio

Compared 8% of the time

Postman vs Katalon Studio

Compared 8% of the time

Testim vs Katalon Studio

Compared 7% of the time

Appium vs Katalon Studio

Compared 7% of the time

Ranorex Studio vs Katalon Studio

Compared 6% of the time

More Katalon Studio Competitors

BrowserStack vs Sauce Labs

Compared 46% of the time

Perfecto vs Sauce Labs

Compared 23% of the time

LambdaTest vs Sauce Labs

Compared 13% of the time

Bitbar vs Sauce Labs

Compared 3% of the time

Applitools vs Sauce Labs

Compared 1% of the time

More Sauce Labs Competitors

OpenText UFT One vs Tricentis Tosca

Compared 11% of the time

Worksoft Certify vs Tricentis Tosca

Compared 10% of the time

Testim vs Tricentis Tosca

Compared 6% of the time

UiPath Test Suite vs Tricentis Tosca

Compared 5% of the time

SmartBear TestComplete vs Tricentis Tosca

Compared 5% of the time

More Tricentis Tosca Competitors

Product Reports

Buyer's Guide

Katalon Studio

October 2024

Download Katalon Studio product report

Buyer's Guide

Sauce Labs

October 2024

Download Sauce Labs product report

Buyer's Guide

Tricentis Tosca

October 2024

Download Tricentis Tosca product report

Learn More

Katalon Studio

Sauce Labs

Tricentis

Overview

Katalon Studio is a regression testing tool that enables you to go low-code, boost productivity, and ease scalability. It is suitable for all platforms and operating systems, regardless of application complexity. The software is built on top of the open-source automation frameworks Selenium and Appium, with a specialized IDE interface for web, API, mobile, and desktop application testing. As a robust automation tool, Katalon Studio lets you run automated tests of UI elements, including pop-ups, iFrames, and wait time. The solution is ideal for both large and small organizations.

Katalon Studio Features

Katalon Studio has many valuable key features. Some of the most useful ones include:

Object spying
Record and playback
Content assist utilities
Advanced debugger
Reusable test artifacts
Fast scripting with keyword-driven testing
BDD convention supported
Flexible test listener
Extensive data-driven testing
Self-healing
Test scheduling and parallel execution
Native CI/CD integrations

Katalon Studio Benefits

There are many benefits to implementing Katalon Studio. Some of the biggest advantages the solution offers include:

Versatile abilities: The solution enables you to identify, capture, and store all on-screen objects. Additionally, you can view every single property, method, field, and event in detail. You can create tests twice as fast with low-code options, recycle recorded artifacts, and also work from any steps on active browsers.

Built-in project templates: Katalon Studio’s ready-made test scenarios, keywords, and object repositories allow you to get started quickly.

One place for end-to-end testing: With the solution, you can combine all of your activities for web UI and API testing in one single project.

Flexible test design options: Katalon Studio is equipped with manual and scripting modes for both beginners and advanced users.

Broad data support: The solution supports multiple data sources (XLS, CSV) and databases with effective parameterization to maximize test coverage.

Smart runtime engine: Because of its smart runtime engine, Katalon Studio can streamline test execution and lower maintenance efforts.

Reviews from Real Users

Katalon Studio is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has a valuable record and playback feature, is user friendly, and has fantastic integration capabilities.

Khurram K., Head of SQA, Project Manager at Vroozi, says, "The best thing about the solution is that there is a record and playback functionality. The solution allows for specific object files [and it] has great multi-parallel languages that work in the facilities here.”

Another PeerSpot user expresses the multiple benefits the solution provides for him exclaiming, “I'd describe it as extremely user-friendly. There's a lot of information that is readily available on the internet, and therefore it's easy to learn about the product itself. The scalability of the product is good. The solution was quite stable throughout the time I used it. We found the installation process to be quite simple. There is also very helpful online documentation that can help you if you ever get stuck during the implementation process itself,” comments a Senior Quality Assurance Analyst at an educational organization.

Tinnaphan W., Professional Services Manager at a non-profit, talks about the Katalon Studio’s advantages. He mentions, “The solution has very good integration capabilities overall. The client has an extremely stable testing framework, and therefore they rely on Katalon to get the results. The reporting is very good.”

Sauce Labs is a functional testing tool that ensures your apps and websites work flawlessly on every browser, OS, and device. The solution allows you to automate functional testing on multiple operating systems and browsers, emulating the way that a user would use the website. With Sauce Labs, you can also run tests on various operating system and browser combinations in parallel, reducing the amount of time to get results. The Sauce Labs solution provides enterprise-grade security, scalability, and reliability.

Sauce Labs Features

Sauce Labs has many valuable key features. Some of the most useful ones include:

Automated cross-browser testing
Mobile testing
Secure tunneling protocol
Usage reporting
Enterprise security
Provisioning
Centralized user account management
Access controls
Support for Selenium, Appium, and JUnit Testing

Sauce Labs Benefits

There are many benefits to implementing Sauce Labs. Some of the biggest advantages the solution offers include:

Speed up development time: The solution makes it possible for you to test web and mobile apps in parallel and accelerate your testing time by up to 10x or more. Using Sauce Labs, you can increase developer productivity because your teams will be able to spend less time with test maintenance and debug faster.

No worrying about infrastructure: With Sauce Labs, you don’t have to buy or maintain more servers or mobile devices. You also don’t need to worry about updating browsers or VM licenses. Sauce Labs allows you to easily scale your tests with parallelization to speed up test cycles and boost capacity on their reliable cloud.

Run tests securely: The solution enables you to securely run your scripts and access your data and files from behind your firewall. Sauce Labs generates single-use VMs for every test and destroys them immediately afterwards so your data always remains secure.

Easy integration for your CI systems: Sauce Labs automated testing platform integrates with Jenkins, Bamboo, Microsoft VSTS, and others so you can test as fast as you develop. In addition, you can share results instantly by using the solution’s simple plugins.

Reviews from Real Users

Sauce Labs is a solution that stands out when compared to many of its competitors. It has valuable features that include error logging, helpful dashboards, and its browser.

Joel A., Product Manager - Data & APIs at a marketing services firm, says, "The error logging is very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."

Savio D., Sr. IT Architect at a healthcare company, mentions, "Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."

PeerSpot reviewer, Rob L., Director of Quality Assurance - Shared Service at a financial services firm, writes, “The most valuable feature for us is the browser. The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.”

Tricentis Tosca is primarily leveraged for test automation across web, SAP, API, and mainframe applications, offering robust support for both regression and functional testing.

Tricentis Tosca's test automation capabilities extend to front-end and back-end testing, including processes like RPA and UI-based regression tests on Microsoft Windows. It supports Agile environments with multiple applications, enabling Salesforce automation, API endpoints, and end-to-end automation workflows. Tosca caters to diverse testing needs, integrating well with tools like Jenkins and Bamboo, although upgrades and customizations present challenges. Licensing costs and performance issues during loading and scanning are concerns, along with substantial learning curves for new users. Enhanced AI features and better reporting are on users' wishlist.

What are the key features of Tricentis Tosca?

Tosca BI: Ensures data integrity and accuracy in business intelligence testing
Tosca Commander: Centralized control for easy test management and maintenance
Model-Based Test Automation: Facilitates test creation without scripting
Integration Capabilities: Works seamlessly with Jenkins and Bamboo for CI/CD
Diverse Application Support: Compatible with mobile, web, APIs, and SAP
Scriptless Nature: Simplifies usage and reduces maintenance efforts

What benefits should users consider?

Enhanced Automation: Streamlines testing processes, saving time and resources
Scalability: Adapts to growing demands within an organization
Test Management: Centralized control enhances efficiency and oversight
Ease of Use: Scriptless approach lowers the barrier to entry for users

Tricentis Tosca is implemented across various industries, serving sectors like finance, healthcare, and retail with test automation solutions to ensure application quality and reliability. Agile teams in these industries benefit from its multi-application support and ability to manage complex end-to-end testing workflows. The tool's integration capabilities are particularly useful in environments that rely on CI/CD pipelines, ensuring continuous testing and quick feedback loops.

Sample Customers

Coca-Cola Tesla Black Board TaTa Consultancy Services Sony

Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.

HBO, AMEX, BMW Group, ING, Bosch, Austrian Airlines, Deutsche Bank, Henkel, Allianz, Bank of America, UBS, Orange, Siemens, Swiss Re, Vodafone

Buyer's Guide

Test Automation Tools

October 2024

Download Free Report

Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools. Updated: October 2024.

DOWNLOAD NOW

814,895 professionals have used our research since 2012.