We have migrated our Selenium IDE script to Katalon.
IT QA Manager at a tech services company with 501-1,000 employees
Customer service is late to reply and do not provide clear guidance, however, the solution is easy to use
Pros and Cons
- "The most valuable feature of Katalon Studio is the ease of use of the solution."
- "The solution can be further improved with better loading time."
What is our primary use case?
What is most valuable?
The most valuable feature of Katalon Studio is the ease of use of the solution. In particular, scripting for a new user is easy.
What needs improvement?
Katalon Studio's support and service need to improve. They reply late and do not provide clear guidance, or a clear transition plan.
The solution can be further improved with better loading time.
In future releases, I would like to see the feature offered by their competitor included in Katalon. The competitors have image testing that captures a certain object on our website. Katalon would benefit by adding this feature.
For how long have I used the solution?
I have been using Katalon Studio for less than one month.
Buyer's Guide
Katalon Studio
December 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
What do I think about the stability of the solution?
It is too early to tell how stable the solution is. We have not tested the tool with the volume that we are expected to have. Currently, we have less than 10 scripts in my team, and they are purely for integrating and navigating.
What do I think about the scalability of the solution?
We have seven users of the product in our organization, which includes six engineers and one manager.
How are customer service and support?
Our company has a success plan that gives us direct access to their technical support and customer success manager. The one problem we are encountering is the language barrier. The support team speaks Vietnamese, making it difficult for them to relay what they are trying to say in English. However, they do know the solution.
The other concern we have with Katalon's customer service and support is that it takes them too long to solve the problem. It can take a day before hearing from them, and often times I need to follow up.
I would rate their service a four out of five overall because they have the knowledge, it is just unorganized and the response time is too slow.
How would you rate customer service and support?
Neutral
Which solution did I use previously and why did I switch?
Prior to using Katalon Studio, we were using Tricentis. We switched because it is a free tool and currently, they are unable to maintain it.
In terms of features, the usability of Tricentis is okay. It has unlimited executions and storage. They have community support, which I don't believe Katalon has, as they resolve concerns primarily through ticketing.
How was the initial setup?
The initial setup of Katalon Studio is easy. It took less than 15 minutes to deploy the product.
What about the implementation team?
The implementation of the product was done through our in-house team.
What other advice do I have?
It is too soon for me to recommend Katalon Studio to other users because we have not used the product long enough to provide feedback. However, my first week with Katalon was disappointing because of the support.
Overall, I would rate Katalon Studio a five out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Consultant at Unifonic
Very user-friendly with a great self-healing plug-in feature; lacks integration with other software
Pros and Cons
- "User-friendly and a good solution."
- "Katalon lacks integration with other software, including integrating other languages like .NET and PHP."
What is our primary use case?
I'm a senior software test automation engineer and we are customers of Katalon.
What is most valuable?
This solution is good for us. It's easy to use and a good product. I like the self-healing plug-in feature which, as far as I am aware, is not available in any other product on the market.
What needs improvement?
Katalon lacks integration ability with other software, including integrating other languages like .NET and PHP. I've also had issues with new releases as the system often crashes and the previous version is no longer supported on a particular feature. More testing needs to be carried out before new versions are released. I'd like to be able to export our test system to any other product. This is currently not possible. Finally, the product only supports XPath and not CSS. CSS is faster than XPath and most companies want to use it. There are a lot of solutions on the market and if an end-user has too many problems with a product, they will jump to a new one.
For how long have I used the solution?
I've been using this solution for two years.
What do I think about the stability of the solution?
Stability is one of the main issues with the system crashing if there's a new release that hasn't been sufficiently tested. The fixes can come after a couple of days but sometimes it can take a couple of months.
What do I think about the scalability of the solution?
The solution is scalable.
How are customer service and support?
I haven't used the support for a while but they were good. The community is also very helpful.
Which solution did I use previously and why did I switch?
I previously worked with Selenium WebDriver and also with Ranorex.
What's my experience with pricing, setup cost, and licensing?
The cost is on the high side and it would be helpful if there were two packages available with a distinction made between the standard features most companies are looking for at a cheaper cost and a second, more expensive license option for those wanting additional features such as auto exports. If Katalon were to do this, I think more of the smaller companies would be interested in using the solution.
What other advice do I have?
I rate this solution seven out of 10.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Katalon Studio
December 2024
Learn what your peers think about Katalon Studio. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
QA Manager at Next Solutions
An install tool useful to fasten automation of test cases
Pros and Cons
- "Whenever I speak to the support team of Katalon Studio, I learn that some new features will be included in the product. It is a scalable product."
- "I can say that in my company, we struggle a lot with iOS automation."
What is our primary use case?
Katalon Studio helps my company because it has made our automation process and automation of test cases faster. Earlier, when my company was using open-source tools like Selenium, we were able to manage around three to four test cases per day. With Katalon Studio's use in some projects, my company manages around ten cases per day, fastening our processes.
What is most valuable?
In Katalon Studio, the record and play feature is valuable as it has reduced the need for my company to do coding and scripting. Katalon Studio serves as a tool meant to make everything codeless, so my company does not have to write too much code, something we like about Katalon Studio as it makes our process faster. Another valuable feature of Katalon Studio is its integration with various other project management and test management tools, like Azure DevOps, TestRail, Jira, etc. In general, integration is also a good feature of Katalon Studio.
What needs improvement?
Speaking of the improvement required in Katalon Studio, I can say that in my company, we struggle a lot with iOS automation. For iOS apps, in my company, we struggle a lot since we set it all up on Mac, an area that can be improved. If Katalon Studio allows for more integrations with other test management and project management tools, it would be great since, right now, its integration capabilities are very limited.
For how long have I used the solution?
If I talk about the free version of Katalon Studio, my company has been using it for a few years. My company has been using Katalon Studio's paid version for less than a year.
What do I think about the stability of the solution?
Stability-wise, I rate the solution an eight out of ten.
What do I think about the scalability of the solution?
Katalon Studio as a product has been scaling up on a day-to-day basis. Whenever I speak to the support team of Katalon Studio, I learn that some new features will be included in the product. It is a scalable product. Scalability-wise, I rate the solution an eight out of ten.
Considering Katalon Studio's paid and free versions, ten people in my company use the product.
My company plans to increase the use of Katalon Studio in our environment, and we are also trying to enter into a partnership program with Katalon so that my company receives more offerings from the product side. For now, my company has purchased Katalon Studio to use on a project-to-project basis.
How are customer service and support?
The solution's technical support is very good. I rate the technical support a nine out of ten.
How would you rate customer service and support?
Positive
How was the initial setup?
The product's initial setup is not at all difficult.
For Katalon Studio's deployment, you can easily just download the ZIP file and install it on your system, and it's all set to go. Nowadays, there is an EXE file, which you download and double-click on to install it on your system, making it very easy to install and set up. Probably, the setup phase of the tool with integrations may take some time, but it is very easy to use. There is a beautiful UI and UX that Katalon Studio provides its users. With Katalon Studio, you can easily just provide the URL of your project management or test management tool, and then you can verify it, link it, and then you can do one-to-one mapping of your test cases as well.
I rate the normal setup phase of Katalon Studio a ten on a scale of one to ten, where one is difficult and ten is easy. For iOS specifically, Katalon Studio's setup phase was difficult.
The solution is deployed on an on-premises model.
Just one person can deploy the solution in a couple of hours.
What's my experience with pricing, setup cost, and licensing?
Price-wise, Katalon Studio is a costly product. Considering what the solution provides its users with, I can say that price-wise, Katalon Studio is an okay product.
What other advice do I have?
Those planning to use Katalon Studio need to identify their purpose for the tool. It is pretty easy to use if someone wants to use Katalon Studio for web and API testing and maybe for use cases concerning just mobile phones or Android. For iOS, Katalon Studio's users might face challenges. It takes a lot of time to set it up, and you will need Mac or Apple to specifically set it up, and then other things, like Mac Apple ID, etc, along with some linkage with Katalon WebDriver. Currently, iOS is something that could be a challenge, but otherwise, for the rest of the things, Katalon Studio is pretty easy to use.
I rate the overall tool an eight out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Delivery Manager at Ionatec
Highly scalable automation process with impressive stability
Pros and Cons
- "The most valuable feature is its automation security capabilities."
- "The integration process with Jira should be enhanced and facilitated."
What is our primary use case?
My use cases were focused on the fintech industry.
How has it helped my organization?
It enabled us to automate numerous tests that were previously done manually.
What is most valuable?
The most valuable feature is its automation security capabilities. It also allows integration with other solutions such as Jira and Slack.
What needs improvement?
The integration process with Jira should be enhanced and facilitated.
For how long have I used the solution?
I have used it for one year and a half.
What do I think about the stability of the solution?
It is a very stable solution. I would rate it nine out of ten.
What do I think about the scalability of the solution?
I would rate its scalability nine out of ten.
What was our ROI?
It saved us a lot of time, so we were really satisfied with it.
What's my experience with pricing, setup cost, and licensing?
The pricing is good. It is the market average.
What other advice do I have?
I am highly satisfied with Katalon Studio and would recommend it to others. I would rate it nine out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Manager, Test Automation Architect at IHiS
Helps to automate web regression
Pros and Cons
- "The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution."
- "The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well."
What is our primary use case?
We use the tool to automate our web regression.
What is most valuable?
The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution.
What needs improvement?
The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well.
For how long have I used the solution?
I have been working with the solution for two and a half years.
What do I think about the stability of the solution?
The tool is stable. I would rate its stability a seven out of ten. The solution takes time to load the test cases.
What do I think about the scalability of the solution?
The tool is scalable. I would rate the tool's scalability an eight out of ten. We use around 28-30 licenses.
How are customer service and support?
The tool's tech support needs to improve. Most of the issues that we have raised, they consider as feature enhancements. However, they are trying to work very closely with us.
Which solution did I use previously and why did I switch?
I have used Selenium, Appium, and Micro Focus UFT. If we wanted to use Selenium or Appium, then we would require to build their framework which Katalon didn't require. Also, pricing was a factor in the decision-making process.
How was the initial setup?
The tool's setup is straightforward. You can just download and use it. I would rate the solution's setup a nine out of ten. The tool is hosted on the Katalon server.
What's my experience with pricing, setup cost, and licensing?
The tool's pricing is cheap compared to other alternatives. I would rate the tool's pricing a three out of ten.
What other advice do I have?
I would rate the overall tool a seven out of ten. You should use this solution if cost is your criteria and don't want to build a framework for yourself. I would suggest using the community edition first for a year and then moving ahead with the enterprise version.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Quality Assurance Team Lead at Elm Co.
A scalable solution with expensive pricing
Pros and Cons
- "I rate Katalon Studio's scalability a four out of five."
- "Katalon Studio's pricing is expensive."
What needs improvement?
Katalon Studio's pricing is expensive.
For how long have I used the solution?
.I have been using the product for three to four years.
What do I think about the stability of the solution?
I rate the product's stability a nine out of ten.
What do I think about the scalability of the solution?
I rate Katalon Studio's scalability a four out of five.
How was the initial setup?
The tool's deployment is easy but difficult for iOS devices. Deployment speed is pretty quick.
What's my experience with pricing, setup cost, and licensing?
The tool's licensing costs are yearly.
What other advice do I have?
I rate Katalon Studio an eight out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Principal Consultant at Inspired Testing
Useful smart healing AI capabilities, user-friendly, and responsive support
Pros and Cons
- "The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
- "Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI."
What is our primary use case?
Katalon Studio is on-premise and our TestOps is in the cloud. The TestOps can be in a private hybrid or public cloud.
Katalon Studio is used for end-to-end test automation, web, desktop, UI, API, and mobile.
How has it helped my organization?
Katalon Studio has improved our organization because it's improving the speed to market and the speed of delivery.
What is most valuable?
The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities.
What needs improvement?
Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI.
For how long have I used the solution?
I have been using Katalon Studio for two years.
What do I think about the stability of the solution?
The performance of Katalon Studio has been good.
What do I think about the scalability of the solution?
I have not seen Katalon Studio scalable, but teams that are adjacent to our line of business, have.
We have approximately 50 people using the solution.
We are using Katalon Studio at approximately 80 to 100 percent. We plan on increasing usage in the future.
How are customer service and support?
The technical support has been good, they are responsive.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We were using Micro Focus UFT previously and switched to Katalon Studio because of pricing.
How was the initial setup?
The initial Katalon Studio is simple, you only need to download and register, and it takes approximately 10 minutes.
We did a POC and then did the implementation and then go with it.
What about the implementation team?
We did the implementation in-house, there is no need for assistance.
Katalon Studio itself doesn't require maintenance. It's the script that requires maintenance, which is normal in any test automation project.
What was our ROI?
We are still busy doing the calculations for the financial ROI, but there has been an ROI when it comes to the speed to market and delivery. That's been affected positively.
What's my experience with pricing, setup cost, and licensing?
Katalon Studio is less expensive than other solutions, such as Micro Focus UFT.
The price of the solution is approximately $1,900 for the licenses, we have 30 licenses. The cost is for the license and for the support. We are billed annually. There are not any extra features or costs for anything else, it is open source.
Which other solutions did I evaluate?
We evaluated Tricentis and Worksoft before choosing Katalon Studio.
What other advice do I have?
The reporting in TestOps could use some upgrades.
Katalon Studio is straightforward and easy to implement. It supports everything from end to end, we have not had any issues.
I rate Katalon Studio a nine out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Head of SQA, Project Manager at Vroozi
Great record and playback functionality but isn't user-friendly and needs better technical support
Pros and Cons
- "The best thing about the solution is that there is a record and playback functionality."
- "The free version of the solution is not user friendly at all."
What is our primary use case?
We have an application that's for secure point management. There are different values on it, starting from PR creation to PO, etc. We log into the application and then create a PR and then a PO, and from there we can run functional test cases.
We use it to identify important areas for regression testing.
What is most valuable?
There is a free version of the solution.
The best thing about the solution is that there is a record and playback functionality.
The solution allows for specific object files.
The solution has great multi-parallel languages that work in the facilities here.
What needs improvement?
The free version of the solution is not user friendly at all.
The solution's most valuable aspect is related to the record and playback. However, they need to improve the record and playback facility. TestComplete and UFT both have a much better record and playback functionality in comparison. It's one of the main reasons why I have, for example, inline tools, like UFT 5.0.
They need to improve their object repository.
The solution isn't as mature as TestComlete or UFT. Although they are continuously writing more functionalities, this is one area they really need to improve in.
Technical support needs to be improved upon.
For how long have I used the solution?
We've been using the solution for three to four years now.
What do I think about the stability of the solution?
The solution is okay in terms of stability, but just not as stable as TestComplete or UFT, two of its competitors.
What do I think about the scalability of the solution?
We have five people working with the solution right now.
This solution was being extensively used on a daily basis in our organization.
However, for the last couple of months we are not using it as much as we were using it. From February, we have reduced the usage of Katalon because we are working on a replacement solution. We're very cost-conscious and the new tool provides us with more value.
The solution does have potential to scale. It would be pretty easy to do so if a company needed to.
How are customer service and technical support?
We've contacted technical support in the past. The support is basically a site where you can record your issues. The feedback I've received from my team is that it's not great technical support and they aren't fully satisfied.
Which solution did I use previously and why did I switch?
We actually started with a solution called Selenium. However, the Selenium GUI was not as comprehensive and the solution itself was not easy to use. We moved to Katalon due to the fact that it was free of charge, and had the record and playback facilities we required.
How was the initial setup?
The initial setup wasn't complex. It was straightforward. I found it to be quite easy.
What about the implementation team?
Due to the fact the process wasn't that difficult, we handled the installation of the solution in-house with our own team.
What's my experience with pricing, setup cost, and licensing?
There is a free version of the solution. That said, companies should be aware that if they do go ahead with the freemium version, the effort required to do the work is extremely high and might negate the positive aspect of having a "free" solution.
Which other solutions did I evaluate?
We've since looked at both UFT and TestComplete. Katalon is cheaper, however, it doesn't offer everything we need and its features aren't as robust as the other two.
What other advice do I have?
We're using the solution as a customer and don't have any sort of relationship or contract with Katalon.
The company gave us a demo to try that includes approximately seven or eight sessions of training to all 15 resources. However, Katalon also has lesson fees associated with the solution. That means we have to spend money, and we need to be strategic and careful now when considering which tool we need to invest in. That's why we are basically working on different tools, including UFT and TestComplete.
We are working with the 4.0 and 5.0 versions, however versions 7.0 and 8.0 have also launched at this point.
Katalon is a good tool if we are comparing it with a developer tool. It's the cheaper option too, however, is not as mature as compared to the other competitors. The lack of maturity may be why it's cheaper.
If a company is looking to buy a user-friendly software testing tool while having to pay less money, Katalon may be the best option as compared to UFT or TestComplete.
I'd rate the solution overall six out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Katalon Studio Report and get advice and tips from experienced pros
sharing their opinions.
Updated: December 2024
Popular Comparisons
Tricentis Tosca
OpenText UFT One
SmartBear TestComplete
Selenium HQ
Appium
Ranorex Studio
ReadyAPI Test
OpenText Silk Test
Telerik Test Studio
IBM DevOps Test UI
Appvance AIQ Platform
Rainforest QA
TestingWhiz
Sahi Pro
Buyer's Guide
Download our free Katalon Studio Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions: