Try our new research platform with insights from 80,000+ expert users
reviewer1549395 - PeerSpot reviewer
It Manager, QA Manager at a comms service provider with 1-10 employees
Real User
Top 20
Simple setup, effective testing, but support could improve
Pros and Cons
  • "The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful."
  • "We have been seeing some error pop-ups that are difficult to understand why they were triggered."

What is our primary use case?

We use Katalon Studio mainly for functional testing.

How has it helped my organization?

For tasks, our manual testers cannot cover Katalon Studio helps us. It speeds up our testing. If we are testing a large application, it benefits if we automate it using Katalon Studio

What is most valuable?

The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful.

What needs improvement?

We have been seeing some error pop-ups that are difficult to understand why they were triggered.

In one of our applications, the solution is not able to recognize some of the elements making it unable to use with it.

Buyer's Guide
Katalon Studio
January 2025
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
832,138 professionals have used our research since 2012.

For how long have I used the solution?

I have been using Katalon Studio for approximately eight months.

What do I think about the stability of the solution?

We have had some errors on occasion. There was a learning curve when using the solution that could have contributed to the stability issues. We had to learn to use the solution from scratch.

What do I think about the scalability of the solution?

Katalon Studio is scalable.

We have seven people using this solution in my department.

How are customer service and support?

Katalon Studio could improve its support. Their response time is slow when we have premium support which includes direct connection with the agents.

New Relic had better support.

Which solution did I use previously and why did I switch?

We previously used other solutions before switching to Katalon Studio.

How was the initial setup?

The initial setup of Katalon Studio is easy. There was some confusion when we were upgrading the versions. The implementation can be done in a few hours.

What's my experience with pricing, setup cost, and licensing?

The price of Katalon Studio is reasonable. They recently had a price increase that might impact new subscribers. We are using a business license.

Which other solutions did I evaluate?

We evaluated other options before selecting Katalon Studio.

What other advice do I have?

We have not had any issues with maintaining the solution.

My advice to others is to test the solution well before purchase and confirm all the elements needed from the sales team. We had some issues at the start.

I rate Katalon Studio a seven out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Consultant at Unifonic
Consultant
Very user-friendly with a great self-healing plug-in feature; lacks integration with other software
Pros and Cons
  • "User-friendly and a good solution."
  • "Katalon lacks integration with other software, including integrating other languages like .NET and PHP."

What is our primary use case?

I'm a senior software test automation engineer and we are customers of Katalon. 

What is most valuable?

This solution is good for us. It's easy to use and a good product. I like the self-healing plug-in feature which, as far as I am aware, is not available in any other product on the market.

What needs improvement?

Katalon lacks integration ability with other software, including integrating other languages like .NET and PHP. I've also had issues with new releases as the system often crashes and the previous version is no longer supported on a particular feature. More testing needs to be carried out before new versions are released. I'd like to be able to export our test system to any other product. This is currently not possible. Finally, the product only supports XPath and not CSS. CSS is faster than XPath and most companies want to use it. There are a lot of solutions on the market and if an end-user has too many problems with a product, they will jump to a new one. 

For how long have I used the solution?

I've been using this solution for two years. 

What do I think about the stability of the solution?

Stability is one of the main issues with the system crashing if there's a new release that hasn't been sufficiently tested. The fixes can come after a couple of days but sometimes it can take a couple of months.  

What do I think about the scalability of the solution?

The solution is scalable. 

How are customer service and support?

I haven't used the support for a while but they were good. The community is also very helpful. 

Which solution did I use previously and why did I switch?

I previously worked with Selenium WebDriver and also with Ranorex. 

What's my experience with pricing, setup cost, and licensing?

The cost is on the high side and it would be helpful if there were two packages available with a distinction made between the standard features most companies are looking for at a cheaper cost and a second, more expensive license option for those wanting additional features such as auto exports. If Katalon were to do this, I think more of the smaller companies would be interested in using the solution. 

What other advice do I have?

I rate this solution seven out of 10. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Katalon Studio
January 2025
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
832,138 professionals have used our research since 2012.
QA Engineer at AKSA-SDS Inc.
Real User
Top 20
User-friendly tool enhances QA automation and app commission processes
Pros and Cons
  • "Katalon Studio is user-friendly."
  • "There could be many improvements, however, I have not noted them down at this moment."

What is our primary use case?

Our organization is using Katalon Studio for QA automation and mobile app commission processes.

How has it helped my organization?

We evaluated Katalon Studio as it provides more comfort and is appropriate for our needs.

What is most valuable?

Katalon Studio is user-friendly. I have broad experience in tools like Appiam and Selenium, and Katalon Studio is a further step ahead with Java.

What needs improvement?

There could be many improvements, however, I have not noted them down at this moment.

For how long have I used the solution?

I have been using Katalon for more than one to two months.

What do I think about the stability of the solution?

Integration with Mac and iOS is complicated, although it is traditionally more complicated for all tools on these platforms.

What do I think about the scalability of the solution?

I can rate it highly on ease and user-friendly adaptation.

How are customer service and support?

I have not contacted their support team.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

I have experience with traditional QA setups like Selenium, Java, Appiam, and more.

What was our ROI?

It depends on the organization's norms and ROI specs. The cost compared to functionality is considerable but depends on the organization's budget.

Which other solutions did I evaluate?

I have evaluated or downloaded reports regarding Katalon Studio and SmartBear TestComplete.

What other advice do I have?

I'd rate the solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Quality Assurance Team Lead at Elm Co.
Real User
A scalable solution with expensive pricing
Pros and Cons
  • "I rate Katalon Studio's scalability a four out of five."
  • "Katalon Studio's pricing is expensive."

What needs improvement?

Katalon Studio's pricing is expensive. 

For how long have I used the solution?

.I have been using the product for three to four years. 

What do I think about the stability of the solution?

I rate the product's stability a nine out of ten. 

What do I think about the scalability of the solution?

I rate Katalon Studio's scalability a four out of five. 

How was the initial setup?

The tool's deployment is easy but difficult for iOS devices. Deployment speed is pretty quick.

What's my experience with pricing, setup cost, and licensing?

The tool's licensing costs are yearly. 

What other advice do I have?

I rate Katalon Studio an eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Mudasir Shafi - PeerSpot reviewer
Testing Lead at Enstoa
Real User
Flexible and cost-effective, but should include support for more frameworks
Pros and Cons
  • "The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
  • "There is not much support offered for the free version, which is something that could be improved."

What is our primary use case?

This is a product that I have been using personally, rather than professionally.

Katalon Studio is basically used for automation. One of the use cases is to automate products that my company is offering to our clients. Another use case is internal automation used to make our own development more efficient.  

What is most valuable?

The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options.

The flexibility that it offers is something that I like.

It supports the Cucumber BDD framework.

What needs improvement?

There is not much support offered for the free version, which is something that could be improved.

Support for more frameworks would be a really good addition to this tool

For how long have I used the solution?

I have been using Katalon Studio for about one year.

What do I think about the stability of the solution?

The stability is fine.

What do I think about the scalability of the solution?

Our use is still in the early phase, so we haven't yet looked at scalability or even how we can scale it up. There are only two of us using it at the moment.

How are customer service and technical support?

When you have a license, the technical support is really good. However, the free version doesn't offer as much as it should. As such, we have not yet reached out to them.

How was the initial setup?

The initial setup was straightforward. Once we had approval for the product, it did not take long to roll it out across the organization. I'm still building a case for it, although there isn't much in terms of roadblocks or issues.

What about the implementation team?

We have an in-house team for deployment so we are thinking about doing it entirely on our own.

What's my experience with pricing, setup cost, and licensing?

We are using the free version of Katalon Studio at this point.

Which other solutions did I evaluate?

Prior to choosing Katalon for testing, we were looking at Selenium and Telerik Test Studio. Katalon offers the free version, which allows us to play around with it. Also, the API and the mobile features are attractive.

What other advice do I have?

With respect to the free version, it is a product that I would recommend. However, at the enterprise level, I would have to evaluate the support and see what they have to offer with the licensed version.

Overall, this is a good tool but at this time, the support is something that I would like to see improved. 

I would rate this solution a six out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Studiant at Edifixio
Real User
Top 20
A free tool with good functionality and reporting features
Pros and Cons
  • "The functionality of the data is very good. You can upload and disperse data using the solution."
  • "Katalon doesn't support testing of hybrid applications. It's a limitation."

What is most valuable?

The functionality of the data is very good. You can upload and disperse data using the solution. The reporting is excellent as well.

What needs improvement?

The browsing is messy. The solution tends to rush the tests on multiple processes. That doesn't work in most cases. They need to write a different script for the same test case on the cloud and another script to run the test on Firefox, for example.

Also, in terms of reporting, in the documentation, it's mentioned that Katalon takes screenshots if the test case fails. But not on all test cases. I need to take screenshots manually.

Often, running parallel test cases at the same time doesn't work. If it launches the first test case and it tries to launch the second test case at the same time, for example, the first test case will finish but the second will not stop. A lot of people are talking about this issue on the forums.

The application is prone to freezing when it loads.

Katalon doesn't support testing of hybrid applications. It's a limitation.

For how long have I used the solution?

I've been using the solution for one month.

What do I think about the stability of the solution?

In general, the solution is stable.

What do I think about the scalability of the solution?

For one machine it's good and easy to use. With this solution, you want to limit yourself to small tests.

How are customer service and technical support?

Technical support isn't very good. I've had problems where I couldn't find answers within the community. I've never used the ticket support system, although they do have one. I've mostly relied on the community to source answers.

Which solution did I use previously and why did I switch?

We previously used Selenium HQ.

How was the initial setup?

The initial setup was a local setup; I simply downloaded it from the website.

What about the implementation team?

I implemented the solution myself.

What's my experience with pricing, setup cost, and licensing?

The tool is free to use.

What other advice do I have?

We are using the cloud deployment model.

I would recommend the tool. For a free solution, it's very good.

I would rate the solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1457445 - PeerSpot reviewer
Executive at a tech services company with 11-50 employees
Real User
Good tool for its price bracket, despite limitations and lack of support for some technologies
Pros and Cons
  • "Katalon Studio's biggest advantage is its price. It's a good tool for the price, albeit with some limitations when you compare it with tools like Tricentis Tosca."
  • "One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area."

What is our primary use case?

I am the manager of a team that provides testing services to clients and we use Kalaton Studio for test automation (mainly for web applications) as well as Jira which we use for test management.

Most of our Katalon Studio deployments are based on a private cloud because we work with companies that have particular concerns about security and they prefer to use either private cloud or on-premises infrastructure with machines internal to the company.

Being based in Portugal, our team size isn't that big compared with other countries like Germany, UK, or the United States. Thus, we are not officially partners with Katalon, but sometimes our clients ask us to facilitate the reselling of Katalon Studio.

What is most valuable?

Katalon Studio's biggest advantage is its price. It's a good tool for the price, albeit with some limitations when you compare it with tools like Tricentis Tosca. However, these tools are in completely differently leagues, just like in football where you have the National league and the Championship league. For specific needs, given its price, Katalon Studio is a good solution.

What needs improvement?

One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area. For example, Tosca, in contrast to Katalon Studio, has support for more than 150 different technologies.

For how long have I used the solution?

I have been working with Katalon Studio for about 18 months. 

What do I think about the stability of the solution?

It is a stable product.

Which solution did I use previously and why did I switch?

We have previously used Micro Focus UFT One and Tosca, and we also have experience using Selenium and Cypress in specific situations.

How was the initial setup?

It's tricky to say whether the setup is easy or not in an absolute sense. In some cases, it's very straightforward, and in general it is easy to set up. We usually take a few days for the installation of Katalon Studio.

What about the implementation team?

We implement Katalon Studio as part of a comprehensive solution that we provide as a service for clients, and it is just one piece of the whole solution. The number of people involved in the initial deployment is completely dependent on the size of the project and the stringency of the security required, but it usually only takes one or two people.

What was our ROI?

We have seen return on investment, but it depends on the application that you need to test. It's like a car; if you buy an expensive car that supports hundreds of thousands of kilometers without expensive repairs in the garage, you get the payback on that investment. And if you buy an expensive car and you only want to use the car on weekends, e.g. 100 kilometers per weekend, you might die before you get return on that investment. So it all depends.

What's my experience with pricing, setup cost, and licensing?

In terms of pricing, Katalon, Selenium, and Cypress all represent a similar level of investment. The software for these tools are either true open source or almost open source (because they charge a small fee), so pricing is a neutral point for me. The price isn't a problem. It's all about compatibility with the application undergoing testing.

If you took twice as many hours to finish something that in another tool you could finish in half the time, then it represents an unnecessary cost. What you don't spend in license fees, you may be spending in the service itself, or in people to support it. These are costs that may become evident later.

Which other solutions did I evaluate?

Other test automation tools that we evaluated are products that we have used previously such as Micro Focus UFT One and open source tools like Selenium and Cypress.

When it comes to Selenium, it is more of a scripting language, while Katalon is a keyword-driven solution in which you can use visual programming.

What other advice do I have?

The biggest piece of advice I can give to others is to first analyze whether the tool is compatible with the application to undergo testing.

I would rate Katalon Studio a seven out of ten. 

Which deployment model are you using for this solution?

Private Cloud
Disclosure: My company has a business relationship with this vendor other than being a customer:
PeerSpot user
Director of Products at Computer Team SA
Real User
AI quality platform used for UI and API testing with the ability to build code libraries
Pros and Cons
  • "The ability to build all libraries with codes and use them in many situations has been most valuable."
  • "What it lacks is the Selenium Grid capabilities."

What is our primary use case?

We use the Community Edition and use it for UI and API testing. 

What is most valuable?

The ability to build all libraries with codes and use them in many situations has been most valuable. It has a very good recorder and the ability even to connect with databases to test data and use it in your scripts.

It gives you full access to all the properties of the browser or the network so you can customize the API scripts or UI scripts.

What needs improvement?

What it lacks is the Selenium Grid capabilities. 

For how long have I used the solution?

I have been using this solution for six months. 

What do I think about the stability of the solution?

This is a stable solution. I would rate it an eight out of ten for stability. 

What do I think about the scalability of the solution?

This is a scalable solution. 

How are customer service and support?

We have only used the documentation and community support for this solution and both are good. 

Which solution did I use previously and why did I switch?

We have moved away from using this solution. The solution we are using now is super fast.

How was the initial setup?

The initial setup is straightforward. Without using the manual, it took me approximately 50 to 60 hours to start being very productive. 

What's my experience with pricing, setup cost, and licensing?

We chose this solution because of cost. It is an affordable solution. It was less than a thousand euros for a server which supports three live servers for a CI/CD pipeline. They do not charge for a license per developer. 

What other advice do I have?

I would advise others take advantage of the ability to use modern software engineering practices with Katalon Studio.

I would rate this solution an eight out of ten. It has features that I haven't found in many other products. It's very advanced in my opinion.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user