Try our new research platform with insights from 80,000+ expert users

IBM DevOps Test UI vs Katalon Studio comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Regression Testing Tools
14th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Functional Testing Tools (29th)
Katalon Studio
Ranking in Regression Testing Tools
2nd
Average Rating
7.8
Reviews Sentiment
6.6
Number of Reviews
46
Ranking in other categories
API Testing Tools (4th), Test Automation Tools (3rd)
 

Mindshare comparison

As of April 2025, in the Regression Testing Tools category, the mindshare of IBM DevOps Test UI is 0.8%, down from 1.4% compared to the previous year. The mindshare of Katalon Studio is 17.1%, up from 16.5% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Regression Testing Tools
 

Featured Reviews

HZ
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
Anuradha.Kapoor Kapoor - PeerSpot reviewer
Functional automation features and the recording functionality saves time but the performance and script execution is slow
I would like to see improvements in how Katalon Studio works with iOS applications, especially with React Native applications. The speed is very slow. It takes time. Katalon Studio also takes my laptop memory, and execution becomes slow for the script. There are parallel execution options. I'm sure their online cloud version must be very fast, but as a service-based company, we are under NDA with our clients and can't run their code on our servers. I would like to see iOS improve and see a more capable recording feature. Katalon Studio has released an AI version, and I have a demo scheduled to see the new features.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Test automation is most valuable because it saves a lot of time."
"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"IBM Rational Functional Tester is very contextual."
"The most valuable feature is the UI component tester."
"The initial setup of Katalon Studio was easy."
"We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy."
"Katalon Studio is easier to use compared to SmartBear TestComplete."
"Katalon Studio's biggest advantage is its price. It's a good tool for the price, albeit with some limitations when you compare it with tools like Tricentis Tosca."
"The basic framework and project organization is very good."
"Whenever I speak to the support team of Katalon Studio, I learn that some new features will be included in the product. It is a scalable product."
"We are now performing automated testing in 15 minutes, which were previously taking a long time when doing it manually."
"The initial setup is pretty straightforward and easy enough to complete."
 

Cons

"If the solution is running on Linux, there are some issues around application compatibility."
"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"The latest version has increased load time before testing can be run."
"It would be helpful if they can integrate a feature for performance testing."
"Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI."
"There could be many improvements, however, I have not noted them down at this moment."
"It should be faster while executing, and there are some defects, like choosing the new device with the test case."
"The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well."
"The integration process with Jira should be enhanced and facilitated."
"The Object Spy is rather frustrating to work with, so I tend not to use it."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"Katalon Studio is a free tool."
"The cost of Katalon Studio is expensive but it is less than some of the other solutions, such as Micro Focus UFT or SmartBear TestComplete. The cost is the main reason we are using Katalon Studio."
"The tool is free to use."
"The product is expensive."
"The solution is more affordable than other vendors."
"The price is not high it's good."
"The tool is affordable."
"There is no cost for setup or licensing."
report
Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
847,862 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
28%
Financial Services Firm
16%
Real Estate/Law Firm
9%
Government
8%
Educational Organization
32%
Computer Software Company
15%
Financial Services Firm
11%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Ask a question
Earn 20 points
What is your experience regarding pricing and costs for Katalon Studio?
I used the trial version of Katalon Studio, which I got for free. For TestComplete, I used an internal license as my organization was partnered with them.
What needs improvement with Katalon Studio?
Extending the certification validity, especially after the trial period, would be beneficial. Providing clearer guidance during the trial period for certification and training modules would also he...
 

Also Known As

IBM Rational Functional Tester
No data available
 

Overview

 

Sample Customers

Edumate
Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Find out what your peers are saying about IBM DevOps Test UI vs. Katalon Studio and other solutions. Updated: March 2025.
847,862 professionals have used our research since 2012.