Try our new research platform with insights from 80,000+ expert users
It Manager, QA Manager at a comms service provider with 1-10 employees
Real User
Top 20
Simple setup, effective testing, but support could improve
Pros and Cons
  • "The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful."
  • "We have been seeing some error pop-ups that are difficult to understand why they were triggered."

What is our primary use case?

We use Katalon Studio mainly for functional testing.

How has it helped my organization?

For tasks, our manual testers cannot cover Katalon Studio helps us. It speeds up our testing. If we are testing a large application, it benefits if we automate it using Katalon Studio

What is most valuable?

The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful.

What needs improvement?

We have been seeing some error pop-ups that are difficult to understand why they were triggered.

In one of our applications, the solution is not able to recognize some of the elements making it unable to use with it.

Buyer's Guide
Katalon Studio
October 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.

For how long have I used the solution?

I have been using Katalon Studio for approximately eight months.

What do I think about the stability of the solution?

We have had some errors on occasion. There was a learning curve when using the solution that could have contributed to the stability issues. We had to learn to use the solution from scratch.

What do I think about the scalability of the solution?

Katalon Studio is scalable.

We have seven people using this solution in my department.

How are customer service and support?

Katalon Studio could improve its support. Their response time is slow when we have premium support which includes direct connection with the agents.

New Relic had better support.

Which solution did I use previously and why did I switch?

We previously used other solutions before switching to Katalon Studio.

How was the initial setup?

The initial setup of Katalon Studio is easy. There was some confusion when we were upgrading the versions. The implementation can be done in a few hours.

What's my experience with pricing, setup cost, and licensing?

The price of Katalon Studio is reasonable. They recently had a price increase that might impact new subscribers. We are using a business license.

Which other solutions did I evaluate?

We evaluated other options before selecting Katalon Studio.

What other advice do I have?

We have not had any issues with maintaining the solution.

My advice to others is to test the solution well before purchase and confirm all the elements needed from the sales team. We had some issues at the start.

I rate Katalon Studio a seven out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
QA Engineer at AKSA-SDS Inc.
Real User
Top 20
User-friendly tool enhances QA automation and app commission processes
Pros and Cons
  • "Katalon Studio is user-friendly."
  • "There could be many improvements, however, I have not noted them down at this moment."

What is our primary use case?

Our organization is using Katalon Studio for QA automation and mobile app commission processes.

How has it helped my organization?

We evaluated Katalon Studio as it provides more comfort and is appropriate for our needs.

What is most valuable?

Katalon Studio is user-friendly. I have broad experience in tools like Appiam and Selenium, and Katalon Studio is a further step ahead with Java.

What needs improvement?

There could be many improvements, however, I have not noted them down at this moment.

For how long have I used the solution?

I have been using Katalon for more than one to two months.

What do I think about the stability of the solution?

Integration with Mac and iOS is complicated, although it is traditionally more complicated for all tools on these platforms.

What do I think about the scalability of the solution?

I can rate it highly on ease and user-friendly adaptation.

How are customer service and support?

I have not contacted their support team.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

I have experience with traditional QA setups like Selenium, Java, Appiam, and more.

What was our ROI?

It depends on the organization's norms and ROI specs. The cost compared to functionality is considerable but depends on the organization's budget.

Which other solutions did I evaluate?

I have evaluated or downloaded reports regarding Katalon Studio and SmartBear TestComplete.

What other advice do I have?

I'd rate the solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Buyer's Guide
Katalon Studio
October 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.
Director of Products at Computer Team SA
Real User
Top 20
AI quality platform used for UI and API testing with the ability to build code libraries
Pros and Cons
  • "The ability to build all libraries with codes and use them in many situations has been most valuable."
  • "What it lacks is the Selenium Grid capabilities."

What is our primary use case?

We use the Community Edition and use it for UI and API testing. 

What is most valuable?

The ability to build all libraries with codes and use them in many situations has been most valuable. It has a very good recorder and the ability even to connect with databases to test data and use it in your scripts.

It gives you full access to all the properties of the browser or the network so you can customize the API scripts or UI scripts.

What needs improvement?

What it lacks is the Selenium Grid capabilities. 

For how long have I used the solution?

I have been using this solution for six months. 

What do I think about the stability of the solution?

This is a stable solution. I would rate it an eight out of ten for stability. 

What do I think about the scalability of the solution?

This is a scalable solution. 

How are customer service and support?

We have only used the documentation and community support for this solution and both are good. 

Which solution did I use previously and why did I switch?

We have moved away from using this solution. The solution we are using now is super fast.

How was the initial setup?

The initial setup is straightforward. Without using the manual, it took me approximately 50 to 60 hours to start being very productive. 

What's my experience with pricing, setup cost, and licensing?

We chose this solution because of cost. It is an affordable solution. It was less than a thousand euros for a server which supports three live servers for a CI/CD pipeline. They do not charge for a license per developer. 

What other advice do I have?

I would advise others take advantage of the ability to use modern software engineering practices with Katalon Studio.

I would rate this solution an eight out of ten. It has features that I haven't found in many other products. It's very advanced in my opinion.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Mudasir Shafi - PeerSpot reviewer
Testing Lead at Enstoa
Real User
Flexible and cost-effective, but should include support for more frameworks
Pros and Cons
  • "The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
  • "There is not much support offered for the free version, which is something that could be improved."

What is our primary use case?

This is a product that I have been using personally, rather than professionally.

Katalon Studio is basically used for automation. One of the use cases is to automate products that my company is offering to our clients. Another use case is internal automation used to make our own development more efficient.  

What is most valuable?

The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options.

The flexibility that it offers is something that I like.

It supports the Cucumber BDD framework.

What needs improvement?

There is not much support offered for the free version, which is something that could be improved.

Support for more frameworks would be a really good addition to this tool

For how long have I used the solution?

I have been using Katalon Studio for about one year.

What do I think about the stability of the solution?

The stability is fine.

What do I think about the scalability of the solution?

Our use is still in the early phase, so we haven't yet looked at scalability or even how we can scale it up. There are only two of us using it at the moment.

How are customer service and technical support?

When you have a license, the technical support is really good. However, the free version doesn't offer as much as it should. As such, we have not yet reached out to them.

How was the initial setup?

The initial setup was straightforward. Once we had approval for the product, it did not take long to roll it out across the organization. I'm still building a case for it, although there isn't much in terms of roadblocks or issues.

What about the implementation team?

We have an in-house team for deployment so we are thinking about doing it entirely on our own.

What's my experience with pricing, setup cost, and licensing?

We are using the free version of Katalon Studio at this point.

Which other solutions did I evaluate?

Prior to choosing Katalon for testing, we were looking at Selenium and Telerik Test Studio. Katalon offers the free version, which allows us to play around with it. Also, the API and the mobile features are attractive.

What other advice do I have?

With respect to the free version, it is a product that I would recommend. However, at the enterprise level, I would have to evaluate the support and see what they have to offer with the licensed version.

Overall, this is a good tool but at this time, the support is something that I would like to see improved. 

I would rate this solution a six out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Quality Assurance Analyst at a educational organization with 501-1,000 employees
Real User
A simple installation with good video tutorials and great stability
Pros and Cons
  • "The scalability of the product is good."
  • "The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product."

What is our primary use case?

For Katalon Studio we tried using it for record and play tasks. We could test it on Windows and different operating systems, such as macOS.

What is most valuable?

I did a small POC and during that time I found the product to be very easy to use. I'd describe it as extremely user-friendly.

There's a lot of information that is readily available on the internet, and therefore it's easy to learn about the product itself.

The scalability of the product is good.

The solution was quite stable throughout the time I used it.

We found the installation process to be quite simple. There is also very helpful online documentation that can help you if you ever get stuck during the implementation process itself.

What needs improvement?

As of now, the product has a complete packet and they could develop more on it. It definitely could improve the interface as well for mobile. While I didn't use it too much while I was working with the solution at the time, I am using mobile a lot now, and I see how helpful it is to have a good interface in place. 

The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product.

For how long have I used the solution?

I didn't use the solution for very long. I did a small POC for about one month or so.

What do I think about the stability of the solution?

The stability of the solution was quite good. There are no bugs or glitches. It doesn't crash or freeze. It's reliable and the performance is great.

What do I think about the scalability of the solution?

The solution is quite scalable. If you go ahead and use the paid version, you can expand it as you need to.

At the time, we had eight to ten people using the solution, however, we are no longer using it, and therefore do not have plans to scale or increase usage.

How are customer service and technical support?

I personally never dealt with technical support. We had a team member in DevOps that would sometimes touch base with them. I can't speak to any personal experience, however.

Which solution did I use previously and why did I switch?

We have used, and continue to use, an in-house automation tool. When that company developed our SIEM work, we built custom SEIM for work in Java and Selenium.

We simply tried Katalon as we were using different operating systems and we wanted to try a solution that worked across them.

How was the initial setup?

The initial setup was not complex at all. The installation was very easy. The configuration, as well, was very straightforward. There are videos online that really help in walking you through the process. If you get stuck at any point you can watch them and they really help navigate you through the process.  

I can't recall exactly how long the process took to complete. 

In terms of maintenance, basically, there was one DevOps employee who was doing everything related to the maintenance part. We also had a manager heading it up. We were basically in different scrum teams and we were working on the same product. We only needed one person to look after everything and manage it as necessary. 

What's my experience with pricing, setup cost, and licensing?

Originally, we did pay a licensing fee, however, the company decided not to continue with the product in the end. For us, it was too expensive.

What other advice do I have?

On Katalon I didn't work much. I did a small POC and it was just for one month. After that, I switched back to our native and our custom in-house automation tool.

We didn't deploy it on the cloud due to the fact that initially, it was freeware, and then it got paid. At that point, our company was not interested in investing that amount of money into a new product when they had their own custom-built solution. They were parallelly building the automation framework in Java and Selenium. They're using test engines for reporting. Going forward, we will be using this framework and not Katalon.

I would recommend the solution to others. I would rate it at an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Étudiant at Edifixio
Real User
A free tool with good functionality and reporting features
Pros and Cons
  • "The functionality of the data is very good. You can upload and disperse data using the solution."
  • "Katalon doesn't support testing of hybrid applications. It's a limitation."

What is most valuable?

The functionality of the data is very good. You can upload and disperse data using the solution. The reporting is excellent as well.

What needs improvement?

The browsing is messy. The solution tends to rush the tests on multiple processes. That doesn't work in most cases. They need to write a different script for the same test case on the cloud and another script to run the test on Firefox, for example.

Also, in terms of reporting, in the documentation, it's mentioned that Katalon takes screenshots if the test case fails. But not on all test cases. I need to take screenshots manually.

Often, running parallel test cases at the same time doesn't work. If it launches the first test case and it tries to launch the second test case at the same time, for example, the first test case will finish but the second will not stop. A lot of people are talking about this issue on the forums.

The application is prone to freezing when it loads.

Katalon doesn't support testing of hybrid applications. It's a limitation.

For how long have I used the solution?

I've been using the solution for one month.

What do I think about the stability of the solution?

In general, the solution is stable.

What do I think about the scalability of the solution?

For one machine it's good and easy to use. With this solution, you want to limit yourself to small tests.

How are customer service and technical support?

Technical support isn't very good. I've had problems where I couldn't find answers within the community. I've never used the ticket support system, although they do have one. I've mostly relied on the community to source answers.

Which solution did I use previously and why did I switch?

We previously used Selenium HQ.

How was the initial setup?

The initial setup was a local setup; I simply downloaded it from the website.

What about the implementation team?

I implemented the solution myself.

What's my experience with pricing, setup cost, and licensing?

The tool is free to use.

What other advice do I have?

We are using the cloud deployment model.

I would recommend the tool. For a free solution, it's very good.

I would rate the solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Search Engineer at a financial services firm with 51-200 employees
Real User
Good support, reasonable price, and allows us to define a model to represent a website and reuse its components
Pros and Cons
  • "I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy."
  • "One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language."

What is our primary use case?

I use it for automated testing. I am not using the latest version because their patches come out rather quickly. I can't patch as quickly.

What is most valuable?

I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy.

What needs improvement?

One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language. 

Other than that, we would want to see new features in every update. We would welcome any kind of improvement in terms of performance, etc.

For how long have I used the solution?

I have been using this solution for a year.

What do I think about the stability of the solution?

Its stability and performance are okay and acceptable.

What do I think about the scalability of the solution?

I am not in a good position to comment on this because I didn't try that out. Currently, we have less than 50 users. 

How are customer service and support?

They are pretty good. They did address my problem. I am satisfied with their support.

How was the initial setup?

It is actually a complex setup. If you want to do it in a good and sustainable way, it is complex to create a model, but if you want to just test things out and very quickly try out this product, then it is easy to get started. So, it is complex to create something that is sustainable. 

Overall, it took about one and a half to two months, which included many test cases implementations. The setup was done within a week.

It does require maintenance, but the maintenance of the server is up to your company policy. It depends on how often you patch your server, and how often you upgrade Java. The maintenance of the test scripts depends on how quickly the product changes. So, it varies.

What about the implementation team?

I was using help from the proprietary vendor.

What's my experience with pricing, setup cost, and licensing?

Its pricing is quite reasonable. If you require their help in getting started, then there is a professional services fee on top of the product license cost.

What other advice do I have?

I would recommend engaging Katalon's services to get started. They do render pretty good help on it.

I would rate Katalon Studio an eight out of 10.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Software Quality Assurance Engineer at a computer software company with 201-500 employees
Real User
Easy to deploy and not hard to learn, but keeps on crashing on Linux and is a bit slow
Pros and Cons
  • "It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
  • "Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."

What is our primary use case?

We are using it for API testing. I am just running it from my local machine. I am using it just locally.

What is most valuable?

It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help.

What needs improvement?

Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful.

It is a bit slow. The other tools on my Mac are not slow, but Katalon is slow. 

For how long have I used the solution?

It has been more than six months.

Which solution did I use previously and why did I switch?

I worked on Postman, but for RPA automation, I just started working with Katalon.

How was the initial setup?

It was easy. I just had to double-click on Mac.

What's my experience with pricing, setup cost, and licensing?

I am using the free version.

What other advice do I have?

It should support all operating systems. Most of the developers use a Linux machine, but it doesn't support Linux. I would like an update from the Katalon team about why it is not working properly on a Linux machine.

I would rate it a six out of 10. It is a good product, but it needs some improvements.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user