Try our new research platform with insights from 80,000+ expert users
PeerSpot user
Business Analyst at a consultancy with 10,001+ employees
Real User
User-friendly, easy to learn and use, a good regression test suite and good reporting
Pros and Cons
  • "This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
  • "My recently-updated Katalon studio version hangs a lot and is not a stable version."

What is our primary use case?

I am automating my current project with web application manual testing.

It's a requirement gathering application and has lots of workflows for the user.

How has it helped my organization?

Manual testing requires a lot of manual processes and time to complete the test cycle. With the help of Katalon, the process is running more smoothly and is less time-consuming.

Regression test suit saves lots of time to complete the whole testing with inbuilt reports in PDF format.

What is most valuable?

The Keyword feature is very good to use in your test cases. 

There are lots of inbuilt Keyword features already there to use, and one can write their own for use in respective test cases.

Less Java knowledge is required to write a keyword.

This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation.

What needs improvement?

My recently-updated Katalon studio version hangs a lot and is not a stable version.

The support system should be improved in many areas such as Katalon Studio forums and the Katalon community page, where developer responses take a lot of time to reply to user questions.

Actually support response time is more than expected.

Buyer's Guide
Katalon Studio
October 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.

For how long have I used the solution?

I have been using this solution for one year.

What do I think about the stability of the solution?

The stability is great.

What do I think about the scalability of the solution?

The scalability of this solution is good.

How are customer service and support?

Technical support for this solution is ok, but it could be improve.

Which solution did I use previously and why did I switch?

I used Selenium, but Katalon is much more user-friendly.

How was the initial setup?

The initial setup of this solution is straightforward.

What about the implementation team?

Dont know about that

What was our ROI?

NA

What's my experience with pricing, setup cost, and licensing?

It is freeware software, so start using it.

Which other solutions did I evaluate?

I did not evaluate other options.

What other advice do I have?

Great tool to start automation, easy to learn and doing.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Manager of Organizational Development at Banco Pichincha
Real User
Has a custom chat in the IDE, a good tutorial, and the ability to always update the solution

What is our primary use case?

I made functional scripts with Katalon Studio integrated with GitLab for another company. For now, I need to know about other tools in order to make functional tests for apps. 

How has it helped my organization?

Katalon Studio is easy to install and to learn for other technical people who work in quality assurance and don't work in developing software for a long time. In the other company, they always use Katalon to build the principal test of the business that they need to run when there are changes. 

What is most valuable?

Easy to learn, I don't need to have any expertise in software development. This tool has a custom chat in the IDE, a good tutorial, and I can always update the solution. I like to work with Gherkin language, and I think that I can have results very soon with Selenium. On the other hand, in the same framework, I can work with web applications, mobile applications or web services, and I can record a test in one browser and run it in another browser.

What needs improvement?

I would like if this tool can work without any problems for React Native.

For how long have I used the solution?

One to three years.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Katalon Studio
October 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
814,649 professionals have used our research since 2012.
Practice Director - QA and SW Testing Services at a tech services company with 1,001-5,000 employees
MSP
Complete solution for testing on a variety of platforms
Pros and Cons
  • "Our clients have requested by all types of testing, including mobile, desktop, and API testing and all of those are covered by Katalon. I find that very valuable, very complete."
  • "I've seen that our clients are not truly aware of the power behind Katalon."

What is our primary use case?

Our primary use is for web automation.

We are an IT consulting services company. As part of our services, we provide testing services. That is why we are constantly looking for some tools and frameworks that might fit with our clients' needs.

We call ourselves agnostic, which means we are not going to be with only one provider. However, I've seen very powerful things behind the Katalon.

What is most valuable?

I find Katalon Studio to be a very complete product. Our clients have requested all types of testing, including mobile, desktop, and API testing and all of those are covered by Katalon. I find that very valuable, very complete.

What needs improvement?

I've seen that our clients are not truly aware of the power behind Katalon. Many of the clients are now ready for the traditional Selenium, perhaps a more friendly layer like Cucumber or SpecFlow. But I think they will understand if we start doing automation with Katalon and they would be much more interested. The automation developers are starting to have really high demand and the salaries have increased, so with Katalon they might be interested in two things - the velocity of testing plus bringing manual testing to the automation world.

For how long have I used the solution?

I have been using Katalon Studio for about a half year, now. I use it for demo purposes with our clients.

Which solution did I use previously and why did I switch?

We previously utilized Katalon for demo purposes. We also used Selenium, not Selenium HQ, but Selenium alone. And I think we are utilizing Cypress and Cucumber with Selenium, in different flavors of languages, et cetera.

What's my experience with pricing, setup cost, and licensing?

I haven't precisely checked the business model behind Katalon, and I would like to understand that as well, because most of our clients ask for licenses and prices, and we don't know. From my understanding, the basic version is free, but it would be interesting to understand the full package.

What other advice do I have?

On a scale of one to ten, I would give Katalon Studio an 8.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Team Leader at a tech vendor with 10,001+ employees
Real User
A good testing solution in a single application environment, but lacking in integration with reporting tools
Pros and Cons
  • "The recording feature of this product is very valuable for our testing purposes."
  • "We would like to see improved integration with various reporting tools; this would make our testing data more complete."

What is our primary use case?

We are currently trialing the solution's test automation functionality.

What is most valuable?

The recording feature of this product is very valuable for our testing purposes.

What needs improvement?

We would like to see improved integration with various reporting tools; this would make our testing data more complete.

For how long have I used the solution?

We have been working with this solution for six months.

What do I think about the stability of the solution?

We have found the solution to be stable during our trials.

What do I think about the scalability of the solution?

The solution is easily scalable in our experience.

How are customer service and support?

We have found the technical support for this product to be very good, and knowledgeable.

How would you rate customer service and support?

Positive

How was the initial setup?

The setup of this solution was very simple for a simple web application, and deployment only took 20 minutes.  However, for multiple applications, the lack of integration makes implementation a longer process.

What other advice do I have?

We would recommend this product for a standalone web application use case, but we would suggest that any business using multiple web applications, should try the solution beforehand using the open-source version that is available.

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Professional Services Manager at a non-profit with 201-500 employees
Real User
Good testing framework with a straightforward setup but needs more features
Pros and Cons
  • "The initial setup is pretty straightforward and easy enough to complete."
  • "It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking."

What is our primary use case?

We primarily use the solution according to customer requests. We don't use it for a specific feature; we tend to use it when and if we are requested to. The client dictates that on their end. It's largely used as an automation testing tool. That's how it is meant to be used.

What is most valuable?

The solution has very good integration capabilities overall. 

The client has an extremely stable testing framework, and therefore they rely on Katalon to get the results. The reporting is very good.

The initial setup is pretty straightforward and easy enough to complete.

The stability, overall, seems to be reliable.

We haven't found the scalability to be lacking.

What needs improvement?

The solution could always add more features. It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking.

I'd like the integration with Jira to be a bit better. 

The pricing could be slightly improved. 

For how long have I used the solution?

I've been using the solution for about a year at this point. It hasn't been that long. We tend to switch back and forth, between solutions. We tend to switch month to month.

What do I think about the stability of the solution?

I haven't come across any stability issues. Our clients haven't complained. It's pretty much big and glitch-free. It does not crash or freeze. Our customers have found it to be reliable.

What do I think about the scalability of the solution?

We haven't found any limitations with the scalability. Our clients haven't hit any barriers as of yet. It's my understanding that the solution can scale. 

How are customer service and technical support?

I've never been in touch with technical support in the past. Therefore, I can't speak to how easy it is to get in touch with them, or how knowledgeable or responsive they are. Unfortunately, I have no insights to share. 

Our team often Googles questions and can find answers online if they need to.

How was the initial setup?

We did not find the initial setup to be overly complex or difficult. it was very straightforward. It was simple.

We have a team that can Google questions and find information online pretty easily if there is any maintenance that needs to be handled. We tend to handle the maintenance aspect for our clients. 

What's my experience with pricing, setup cost, and licensing?

It's my understanding that the pricing could be improved upon. I cannot recall the exact pricing. I cannot speak to the cost or licensing terms. We're just basically maintaining the solution for our clients. 

What other advice do I have?

We are just end-users and use it according to our client's requirements. We don't have a specific business relationship with Katalon.

Some customers use ALM, and we use Jira, due to the lower price. These help us with project management aspects. This solution isn't well known, as it might be in other countries. 

This solution is very useful for companies, such as banks or insurance organizations, that need something that can be used for commercial purposes. It's a good solution for enterprise-level companies.

I'd rate the solution at a seven out of ten. It's okay, however, if it offered more features to its customer base, it would be much better.

Disclosure: My company has a business relationship with this vendor other than being a customer: Integrator
PeerSpot user
Software Test Engineer at a tech services company with 1,001-5,000 employees
Real User
User-friendly with good object recognition, and priced well
Pros and Cons
  • "One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
  • "Now we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time."

What is most valuable?

It's very user-friendly and convenient. The forum and the people who use Katalon have been very helpful.

One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements. It was amazing and helped me resolve some of the issues that I was having.

Previously with another application, we had to create an expert dynamically and used the running of tests which provided a solution for it.

What needs improvement?

It would be helpful if we could develop from scripts in other languages. For example Python. It would be more convenient than working with Jira and Java. For some of my colleagues who don't have the knowledge in the development, it is easier to work with Python rather than with Java.

After two years of using this solution for free, we were limited in the features that we could use and had to start to pay for them. Now, we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time.

I would like to see it integrate other tools other than Jira, and to have support in other development languages would be helpful.

For how long have I used the solution?

I have been working with Katalon Studio for over a year.

What do I think about the scalability of the solution?

We have three users in our organization who are using this product.

How are customer service and technical support?

My experience with technical support was that they were kind and friendly, but when I spoke with them regarding the pricing issue and the free solution, they were not as kind.

In other read or questions and requests, they are very kind and friendly. 

Also, they have a forum that is very useful.

Which solution did I use previously and why did I switch?

Previously, we have used other applications and API. For some projects, we use a combination of applications and API.

How was the initial setup?

The initial setup was easy and straightforward. 

I didn't have any requirements.

It took a month to deploy 10 automating services.

What's my experience with pricing, setup cost, and licensing?

Katalon Studio was offered free at first, and we could easily use it. After two years, some of the features were limited and we had to pay. Because of the sanctions, we had difficulties in being able to use a solution and having to pay for it. Our economic situation is not good and has created many difficulties.

The price is reasonable, but our sanctions do not allow us to pay for any international tools.

We have to find other companies to pay for us, without it costing us any money.

The price is not high, it's good. 

Which other solutions did I evaluate?

My colleagues and I did a comparison between Ranorex Studio and Katalon Studio. 

Katalon Studio provides us with a free solution for some of our basic features. Ranorex is very expensive for us. Both are user-friendly and we can work with both of these solutions easily.

What other advice do I have?

Once we developed a new solution, Katalon was no longer free, and we had to pay for all of the features.

Katalon has provided me with a solution to the issues and limitations that I was experiencing.

I have many limitations and issues with automating their application. I did not use the mobile features offered by Katalon Studio.

I would recommend it for anyone who doesn't want to be involved in developing a lot. some people want to use some resources to automate the application of their data system.

I think that if you have some knowledge of development and using Python in addition to Robot Framework, Framework is better. It allows them to do whatever they want.

For those who do not have development knowledge, I would recommend Katalon Studio.

I would rate Katalon Studio an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Test Engineer at a tech services company with 51-200 employees
Real User
Provides cost-effective functional testing for web-based GUIs
Pros and Cons
  • "We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy."
  • "The Object Spy is rather frustrating to work with, so I tend not to use it."

What is our primary use case?

We use this solution for functional testing on some backends, APIs, the ServiceNow GUI, and other web GUIs. 

We have it running on a few machines, in-house. Each developer downloads it to their machine, and we also have it running on a test server. 

What is most valuable?

This solution is written in Groovy, which means that we can write Groovy scripts that work with it. We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy.

From a user's perspective, this solution is better than Micro Focus UFT.

The documentation for this solution could be improved. However, it is a freeware, and the documentation is still better than that of UFT.

What needs improvement?

At the moment, this solution only works for web-based products. It's sort of like a Selenium wrapper, which is quite well done.

The Object Spy is rather frustrating to work with, so I tend not to use it. Instead, I just go and look at the objects in the HTML code, in Chrome for example. A more user-friendly Object Spy would be an improvement.

I would like to see the extension to other GUIs such as Windows and SAP.

For how long have I used the solution?

We have been using this solution for less than six months.

What do I think about the stability of the solution?

The stability of this solution is good and improving.

What do I think about the scalability of the solution?

This product is installed on your own client, and it runs fine there. Scalability is not really an issue. There are two of us using this solution at the moment, and we plan on maybe going up to three or four. There is only a certain amount of testing and automation required for our project.

How are customer service and technical support?

Technical support for this solution is mainly through forums, and the forums are quite good. 

Which solution did I use previously and why did I switch?

We are trying to get away from Micro Focus products because they're extremely expensive. For functional testing, we're migrating to Katalon Studio, for example. 

In the organization as a whole, people are using UFT from Micro Focus, and they are paying a lot of money for it. From the perspective of the user, I would say that this solution is better than UFT, and would encourage people to migrate from UFT to Katalon.

Personally, I have also used Rational Functional Tester, Tricentis Tosca, and Ranorex.

Tosca has a very good analysis, but if you're working with complex web GUIs, such as Angular for example, then Tosca is a pain in the neck. Tosca is more for test analysis.

Ranorex is a good product and it is more flexible. I believe that it can handle Windows GUIs, which Katalon cannot do at the moment. However, Katalon is free, and they are also implementing Winium if we should have the need for Windows GUIs.

How was the initial setup?

The initial setup is straightforward. You just download a ZIP file, copy the contents of it into a directory, and you're ready to go. It is a bit like installing Eclipse. The deployment is quick.

What's my experience with pricing, setup cost, and licensing?

This product is freeware, so there is no charge for using it.

There is a paid service available that offers a cloud database where you can store your test cases, pull your test executions, get reports, etc. We're not currently using this service so I cannot comment on it.

Which other solutions did I evaluate?

I was recently tasked with looking at different testing tools, and I evaluated several including Katalon. Once I tried it, I liked it, and so far we've been happy with it.

What other advice do I have?

My advice for anybody who is considering this project to have some familiarity with Groovy and Java. If you don't like coding then it will not be the product for you. Otherwise, in our experience, it's a good product. It is well thought through and continues to improve.

This solution semi-automatically updates to the latest version, so it is always up to date.

I would rate this solution an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user752019 - PeerSpot reviewer
QA Engineer at a tech company with 11-50 employees
Vendor
It scales well, supporting the execution of large test suites

What is most valuable?

  1. Katalon Studio provides the team much flexibility to adapt to various situations to address a problem appropriately. There are certain test cases that can only be tested manually, but Katalon allows the team to automate as many test cases as possible.
  2. The “Debug from here” feature reduces the debugging time considerably.
  3. It produces detailed and useful logs, helping the team to detect a defect’s root causes easily.
  4. It scales well, supporting the execution of large test suites.
  5. It can be used to verify various issues, ranging from minor errors like typos to performance and stability problems of the system.

How has it helped my organization?

Before using Katalon Studio, we spent weeks to verify all test cases manually for every major build. Now, we need only several days to fully perform regression testing, reducing the time to market greatly.

What needs improvement?

While the web testing is great, we expect more from the API testing.

For how long have I used the solution?

More than six months.

What was my experience with deployment of the solution?

No. It's very easy to deploy.

What do I think about the stability of the solution?

Rarely.

What do I think about the scalability of the solution?

Not yet.

How are customer service and technical support?

Customer Service:

They provide very good customer service.

Technical Support:

Excellent, since they promptly respond to our requests.

Which solution did I use previously and why did I switch?

Robot Framework. However, it required more technical involvement, so the dev team needed to join and spent time setting up before our QA could join.

What about the implementation team?

In-house.

What was our ROI?

After several years using Katalon Studio, the team now already automates more than 20% of the test cases, saving much of the verification time as well as exceeding the target set when starting the test automation effort.

What's my experience with pricing, setup cost, and licensing?

The tool has been completely free until now.

Which other solutions did I evaluate?

TestComplete and UFT. They're all costly.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user