Try our new research platform with insights from 80,000+ expert users
reviewer1457445 - PeerSpot reviewer
Executive at a tech services company with 11-50 employees
Real User
Good tool for its price bracket, despite limitations and lack of support for some technologies
Pros and Cons
  • "Katalon Studio's biggest advantage is its price. It's a good tool for the price, albeit with some limitations when you compare it with tools like Tricentis Tosca."
  • "One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area."

What is our primary use case?

I am the manager of a team that provides testing services to clients and we use Kalaton Studio for test automation (mainly for web applications) as well as Jira which we use for test management.

Most of our Katalon Studio deployments are based on a private cloud because we work with companies that have particular concerns about security and they prefer to use either private cloud or on-premises infrastructure with machines internal to the company.

Being based in Portugal, our team size isn't that big compared with other countries like Germany, UK, or the United States. Thus, we are not officially partners with Katalon, but sometimes our clients ask us to facilitate the reselling of Katalon Studio.

What is most valuable?

Katalon Studio's biggest advantage is its price. It's a good tool for the price, albeit with some limitations when you compare it with tools like Tricentis Tosca. However, these tools are in completely differently leagues, just like in football where you have the National league and the Championship league. For specific needs, given its price, Katalon Studio is a good solution.

What needs improvement?

One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area. For example, Tosca, in contrast to Katalon Studio, has support for more than 150 different technologies.

For how long have I used the solution?

I have been working with Katalon Studio for about 18 months. 

Buyer's Guide
Katalon Studio
December 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.

What do I think about the stability of the solution?

It is a stable product.

Which solution did I use previously and why did I switch?

We have previously used Micro Focus UFT One and Tosca, and we also have experience using Selenium and Cypress in specific situations.

How was the initial setup?

It's tricky to say whether the setup is easy or not in an absolute sense. In some cases, it's very straightforward, and in general it is easy to set up. We usually take a few days for the installation of Katalon Studio.

What about the implementation team?

We implement Katalon Studio as part of a comprehensive solution that we provide as a service for clients, and it is just one piece of the whole solution. The number of people involved in the initial deployment is completely dependent on the size of the project and the stringency of the security required, but it usually only takes one or two people.

What was our ROI?

We have seen return on investment, but it depends on the application that you need to test. It's like a car; if you buy an expensive car that supports hundreds of thousands of kilometers without expensive repairs in the garage, you get the payback on that investment. And if you buy an expensive car and you only want to use the car on weekends, e.g. 100 kilometers per weekend, you might die before you get return on that investment. So it all depends.

What's my experience with pricing, setup cost, and licensing?

In terms of pricing, Katalon, Selenium, and Cypress all represent a similar level of investment. The software for these tools are either true open source or almost open source (because they charge a small fee), so pricing is a neutral point for me. The price isn't a problem. It's all about compatibility with the application undergoing testing.

If you took twice as many hours to finish something that in another tool you could finish in half the time, then it represents an unnecessary cost. What you don't spend in license fees, you may be spending in the service itself, or in people to support it. These are costs that may become evident later.

Which other solutions did I evaluate?

Other test automation tools that we evaluated are products that we have used previously such as Micro Focus UFT One and open source tools like Selenium and Cypress.

When it comes to Selenium, it is more of a scripting language, while Katalon is a keyword-driven solution in which you can use visual programming.

What other advice do I have?

The biggest piece of advice I can give to others is to first analyze whether the tool is compatible with the application to undergo testing.

I would rate Katalon Studio a seven out of ten. 

Which deployment model are you using for this solution?

Private Cloud
Disclosure: My company has a business relationship with this vendor other than being a customer:
PeerSpot user
reviewer823641 - PeerSpot reviewer
Senior Search Engineer at a financial services firm with 51-200 employees
Real User
Good support, reasonable price, and allows us to define a model to represent a website and reuse its components
Pros and Cons
  • "I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy."
  • "One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language."

What is our primary use case?

I use it for automated testing. I am not using the latest version because their patches come out rather quickly. I can't patch as quickly.

What is most valuable?

I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy.

What needs improvement?

One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language. 

Other than that, we would want to see new features in every update. We would welcome any kind of improvement in terms of performance, etc.

For how long have I used the solution?

I have been using this solution for a year.

What do I think about the stability of the solution?

Its stability and performance are okay and acceptable.

What do I think about the scalability of the solution?

I am not in a good position to comment on this because I didn't try that out. Currently, we have less than 50 users. 

How are customer service and support?

They are pretty good. They did address my problem. I am satisfied with their support.

How was the initial setup?

It is actually a complex setup. If you want to do it in a good and sustainable way, it is complex to create a model, but if you want to just test things out and very quickly try out this product, then it is easy to get started. So, it is complex to create something that is sustainable. 

Overall, it took about one and a half to two months, which included many test cases implementations. The setup was done within a week.

It does require maintenance, but the maintenance of the server is up to your company policy. It depends on how often you patch your server, and how often you upgrade Java. The maintenance of the test scripts depends on how quickly the product changes. So, it varies.

What about the implementation team?

I was using help from the proprietary vendor.

What's my experience with pricing, setup cost, and licensing?

Its pricing is quite reasonable. If you require their help in getting started, then there is a professional services fee on top of the product license cost.

What other advice do I have?

I would recommend engaging Katalon's services to get started. They do render pretty good help on it.

I would rate Katalon Studio an eight out of 10.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Katalon Studio
December 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
Software Quality Assurance Engineer at a computer software company with 201-500 employees
Real User
Easy to deploy and not hard to learn, but keeps on crashing on Linux and is a bit slow
Pros and Cons
  • "It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
  • "Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."

What is our primary use case?

We are using it for API testing. I am just running it from my local machine. I am using it just locally.

What is most valuable?

It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help.

What needs improvement?

Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful.

It is a bit slow. The other tools on my Mac are not slow, but Katalon is slow. 

For how long have I used the solution?

It has been more than six months.

Which solution did I use previously and why did I switch?

I worked on Postman, but for RPA automation, I just started working with Katalon.

How was the initial setup?

It was easy. I just had to double-click on Mac.

What's my experience with pricing, setup cost, and licensing?

I am using the free version.

What other advice do I have?

It should support all operating systems. Most of the developers use a Linux machine, but it doesn't support Linux. I would like an update from the Katalon team about why it is not working properly on a Linux machine.

I would rate it a six out of 10. It is a good product, but it needs some improvements.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Technical Project Lead, Agile Coach, IT Educator at Asia Pacific College
Real User
Stable and good for API and continuous integration testing
Pros and Cons
  • "It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
  • "It would be helpful if they can integrate a feature for performance testing."

What is our primary use case?

We're using it for API testing. It is deployed on my desktop.

What is most valuable?

It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins.

What needs improvement?

I believe it would a great feature if they could integrate JMETER and other performance testing tools so that Katalon would become an all-in-one test automation tool

For how long have I used the solution?

I have been using this solution for almost two years.

What do I think about the stability of the solution?

It is a reliable solution.

What do I think about the scalability of the solution?

I have not scaled it or used any plug-in. Currently, we have less than five users of this product.

How are customer service and technical support?

I haven't contacted their technical support because everything is okay.

How was the initial setup?

It wasn't complex.

What's my experience with pricing, setup cost, and licensing?

We are using the free version. We plan on getting a paid version because there is a limitation in terms of the number of users. We want to maximize it.

What other advice do I have?

It is a mature product, and it is a good starting point for beginners. It is pretty much similar to the other tools in the market.

I would rate Katalon Studio an eight out of 10. It is not perfect, but it is an excellent tool.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer977307 - PeerSpot reviewer
Lecturer and Researcher at a non-tech company with 10,001+ employees
Real User
Powerful yet easy-to-use and focuses on the end-user as well as interface testing
Pros and Cons
  • "This is a product that is well ahead of its immediate competition in features and functionality."
  • "They need to work on documentation to make it more centralized and easier to find what you are looking for."

What is our primary use case?

We are using this product as a tool to teach students about testing. We are not teaching them how to use this specific tool. We are helping the students to understand how to find the right tools to do the testing on what they develop.  

How has it helped my organization?

fast learning curve tool (and profesional) for students new at the subject

What is most valuable?

The most valuable features for me are that Katalon Studio is powerful and yet easy-to-use. This solution — even in comparison to Selenium, which we were using previously — is a little bit more simple from a user's standpoint. It is interesting because it is not only focused on the end-user but interface testing — and that includes API testing. Even if we do not generally need to use it, it is interesting. We are a university and we have a very small department that is doing development testing of software. Most of the projects are not API-based. We still are employing some old client-server versions and software architecture. But the capability is still interesting looking forward.  

I have worked with the record and replay feature which helps to create test cases. It is quite useful for assisting in testing a user interface and a very good experience for students' understanding of procedures.  

What needs improvement?

I really do not know what every user who is using this product might need to make it better for them. I do not think this is an easy question to answer for users globally. I do not think there are any features that we need. We had a small problem with an update of the web browser, but we managed to figure it out. New features are not part of our usage for the product.  

I think the one thing that is more problematic for the product is the online documentation. It could be more centralized and better or just easier to find.  

For how long have I used the solution?

We have been using Katalon Studio off and on as a teaching tool at our university for maybe two years.  

What do I think about the stability of the solution?

It is OK.
We had 3rd party problem (browser update) that broken the test case. But it was fixable.

What do I think about the scalability of the solution?

We do not really have a reason to test the scalability, but it should be quite scalable. For the training project, it is only something students do for a few weeks. It depends on the team, but between two and six weeks, and no more. We get an average of about fifty students in their third year right now. They launch an initial development project including testing activity. The use of this kind of tools is optional and tool selection depends on the student group. The do not develop more than 2/3 sprints.

Which solution did I use previously and why did I switch?

Within the department, we were previously using Selenium a few years back for teaching testing. We actually switched to Katalon from student suggestions. In the future, we may change again.  

The most important thing about the product is that we can use it to teach about testing. So it was not imperative to switch but it is also good for students to have varied product experiences.  

How was the initial setup?

The initial setup takes a couple of weeks. That is not really too long for a product like this. It was relatively easy to do.  

Which other solutions did I evaluate?

One of my colleagues is in charge of teaching software engineering testing issues. When the students are tackling the testing project, they sometimes suggest using different tools. Some years ago it was Selenium, nowadays it is Katalon. Of course, there are other tools that perhaps in the future we will suggest to the students to use in their projects. We are not teaching them to be professional users of Katalon and we will continue to evaluate tools and take suggestions for future packages.  

What other advice do I have?

In looking at Katalon Studio and comparing it with Selenium, I think Katalon is better. The capture and replay functionality for sure sets Katalon ahead. As far as the API testing, we have not tried to explore that part. I have only heard that Katalon is very powerful in that capacity. Katalon is easier to work with and to integrate. Those are the main strengths and the differences we have found between the products.  

I would rate Katalon Studio as an eight-of-ten overall on a scale from one to ten where one is the worst and ten is the best. It should be considered that we are not very demanding users. We have not put a lot of stress on the product in our testing.  

To get a nine or ten, if they could provide some capabilities with artificial intelligence to help to assist testing models that could help people to improve in finding the best-case scenarios. Version testing might be an option as well. But Katalon is much closer to getting ten points than Selenium.  

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1315773 - PeerSpot reviewer
Programmer Analyst at a computer software company with 1,001-5,000 employees
Real User
Easy to use, runs Selenium scripts, and the element capture is helpful
Pros and Cons
  • "It is easy for a non-technical person to use and adopt."
  • "It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code."

What is our primary use case?

We are using Katalon Studio for test automation. There are multiple use cases including creating Selenium scripts to help guarantee RPA frameworks.

What is most valuable?

The most valuable feature is the Element capture. It is capable of scanning the application, recording, and capturing the elements.

You can develop a Selenium script and execute it in Katalon Studio.

There are multiple ways that you can guarantee the functionality of RPA frameworks.

Katalon makes it easy for the automation engineer to create automation scripts.

There are lots of script creation options including for the desktop and the API.

It is easy for a non-technical person to use and adopt.

What needs improvement?

It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code.

There is no centralized repository for documentation, which is something that would assist users.

For how long have I used the solution?

I have been using Katalon Studio for about a year and a half.

What do I think about the stability of the solution?

This is a stable solution.

What do I think about the scalability of the solution?

Katalon Studio is scalable because of the cost, and that you can execute Selenium scripts.

We have three people in our team who use it.

How are customer service and technical support?

My opinion of the technical support is that it is average. I am satisfied with it.

What's my experience with pricing, setup cost, and licensing?

Katalon Studio is a free tool.

What other advice do I have?

Overall, it is a good tool in the market for test automation.

I would rate this solution an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1258533 - PeerSpot reviewer
Test Lead at a financial services firm with 1,001-5,000 employees
Real User
Good end-to-end UA, Web,API, and mobile app testing capability
Pros and Cons
  • "The basic framework and project organization is very good."
  • "We have had some issues when it comes to stability, which is something that needs to be improved."

What is our primary use case?

We primarily use this solution for user acceptance testing, web testing, regression testing, and mobile app testing.

What is most valuable?

The most valuable feature is the capability of doing end-to-end testing for both web and mobile apps.

The basic framework and project organization is very good.

Data design testing capabilities are useful.

What needs improvement?

The maintenance of the tools can be improved.

We have had some issues when it comes to stability i.e when project has lot of items in workspace, which is something that needs to be improved.

For how long have I used the solution?

I have been using Katalon Studio for just under two years.

What do I think about the stability of the solution?

At times, Katalon is a little bit non-stable i.e When a project has lot of items in workspace, it takes a while to save . We have had a couple of issues related to instability for more complex models, but we are hoping that it will get better. Because of these issues, we are not able to integrate this solution into our platform.

What do I think about the scalability of the solution?

The scalability is okay for our immediate purposes. We have a maximum of ten users who are all test engineers.

How are customer service and technical support?

We did have a couple of questions for technical support but we did not have direct interaction with them. Instead, we asked them through the web community forums, and some of them were answered.

It was a difficult problem so that may be why not all of our questions were answered. Also, you don't always get reliable answers from the community. For example, we followed some free advice to help with the implementation and it was not good for that purpose.

Which solution did I use previously and why did I switch?

Prior to Katalon Studio, we were using UFT for our testing. We switched because Katalon is free and doesn't cost any money. It works in the meantime, and they have the capabilities that we need. The cost was definitely a factor.

How was the initial setup?

The initial setup is really simple, which is one of the good things about this product.

It was really easy to implement and use. I look for information online from Katalon before we started our testing.

What about the implementation team?

We completed the implementation using our in-house team.

It takes two or three people to deploy and maintain this solution.

What's my experience with pricing, setup cost, and licensing?

There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well.

Which other solutions did I evaluate?

We did not evaluate other options. We needed certain capabilities and we found Katalon to be acceptable.

What other advice do I have?

It is a good product. I would recommend it because they are promoting that they will update it for free, for life. We have had issues with stability but it might be better with the licensed version.

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1582521 - PeerSpot reviewer
QA Architect at a media company with 201-500 employees
Real User
Easy to setup, with fast automation and not overly technical
Pros and Cons
  • "The automation is very fast and you don't need to be overly proficient in coding."
  • "There could potentially be more reporting within the solution. We need more issue reports, for example."

What is our primary use case?

We will primarily use the solution for regression testing.

What is most valuable?

Katalon is very easy to record and then we can use the identifiers very easily. Katalon automatically gets you all the identifiers. It's very user-friendly. How it finds the objects and gets the identifiers is excellent.

The initial setup is very easy.

The automation is very fast and you don't need to be overly proficient in coding.

What needs improvement?

I just started using it, however, if I get the demo, I'm looking for mobile as well, so that I can get more area on it. As of right now, I don't have that much. I'm just starting with it. Once I get to be a full-fledged user, then I can give better input.

There could potentially be more reporting within the solution. We need more issue reports, for example. 

For how long have I used the solution?

We've only been using the solution for a couple of months at this point. It's still pretty new to us. We're still exploring the product.

What do I think about the stability of the solution?

We are still very new to the solution and we need more time to test the stability, to see if it is reliable. We haven't had any problems just yet, however, we haven't had enough time with the product to really make a judgment call on stability.

What do I think about the scalability of the solution?

We are still simply exploring the solution and therefore only have maybe ten users on the solution at this time.

How are customer service and technical support?

I've never had an opportunity to interact directly with technical support. I cannot speak to how helpful or responsive they are.

Which solution did I use previously and why did I switch?

We have used Selenium in the past.

How was the initial setup?

We did not find the initial setup to be very difficult or complex. It was straightforward. It was easy. A company shouldn't have any trouble with the process.

We were using the trial version and it was very easy to install.

What about the implementation team?

We mostly installed the trial version ourselves, although we were in touch with Katalon during the process.

Which other solutions did I evaluate?

Before implementing Katalon, we compared it with Selenium, which we were already using.

If a user has good programmatic skills, I'd go for Selenium. Otherwise, due to its relative speed and faster automation, I'd go for Katalon.

What other advice do I have?

We want to use Katalon Studio RE. I had a call with the salesperson. He said that he'll arrange one day a demo, however, that has not been scheduled yet.

In general, I would rate the solution at a seven out of ten.

I'd recommend it specifically for users that don't have that much programming prowess.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user