I would like Katalon Studio to develop manual test case generation using AI capabilities, as other tools like those using OpenAI are already doing this. Also, enhancing its test management aspects and improving support levels with translators for non-English speakers would be beneficial.
It should be faster while executing, and there are some defects, like choosing the new device with the test case. Parallel execution is available, but not with the free version. The videos or training videos are not providing proper information on setup, and it should give more insights so everyone can understand.
I would like to see improvements in how Katalon Studio works with iOS applications, especially with React Native applications. The speed is very slow. It takes time. Katalon Studio also takes my laptop memory, and execution becomes slow for the script. There are parallel execution options. I'm sure their online cloud version must be very fast, but as a service-based company, we are under NDA with our clients and can't run their code on our servers. I would like to see iOS improve and see a more capable recording feature. Katalon Studio has released an AI version, and I have a demo scheduled to see the new features.
Senior Software Quality Assurance Engineer at a consultancy with 1,001-5,000 employees
Real User
Top 20
2024-04-02T08:48:53Z
Apr 2, 2024
Test report generation must be improved. It doesn’t fetch the right data. Even if we provide the proper screenshots, some are not fetched properly. HTML and PDF work fine. Sometimes, the client needs the report in Excel format. So, we skip the images because they are not properly implemented in Excel. Most clients know it. During parallel execution, some reports are randomly switched. We perform standalone switching to avoid such scenarios. The tool would be better if it improves object repository handling, Excel properties, serial execution, report generation, and scenario preparation.
Speaking of the improvement required in Katalon Studio, I can say that in my company, we struggle a lot with iOS automation. For iOS apps, in my company, we struggle a lot since we set it all up on Mac, an area that can be improved. If Katalon Studio allows for more integrations with other test management and project management tools, it would be great since, right now, its integration capabilities are very limited.
The product’s regression testing time could be reduced. The dashboards also take too much time to load. Additionally, its licenses are expensive. We have to purchase two licenses, including an enterprise license and a KRE license.
The product is comparatively slow. It is very slow when calling a test case within another test case and searching for it. The product is slow in the test case and execution. The product should be made more smooth and speedy.
The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well.
It Manager, QA Manager at a comms service provider with 1-10 employees
Real User
Top 20
2023-03-15T09:38:30Z
Mar 15, 2023
We have been seeing some error pop-ups that are difficult to understand why they were triggered. In one of our applications, the solution is not able to recognize some of the elements making it unable to use with it.
IT QA Manager at a tech services company with 501-1,000 employees
Real User
2022-10-11T09:06:00Z
Oct 11, 2022
Katalon Studio's support and service need to improve. They reply late and do not provide clear guidance, or a clear transition plan. The solution can be further improved with better loading time. In future releases, I would like to see the feature offered by their competitor included in Katalon. The competitors have image testing that captures a certain object on our website. Katalon would benefit by adding this feature.
Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI.
Katalon lacks integration ability with other software, including integrating other languages like .NET and PHP. I've also had issues with new releases as the system often crashes and the previous version is no longer supported on a particular feature. More testing needs to be carried out before new versions are released. I'd like to be able to export our test system to any other product. This is currently not possible. Finally, the product only supports XPath and not CSS. CSS is faster than XPath and most companies want to use it. There are a lot of solutions on the market and if an end-user has too many problems with a product, they will jump to a new one.
Executive at a tech services company with 11-50 employees
Real User
2022-03-31T09:54:37Z
Mar 31, 2022
One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area. For example, Tosca, in contrast to Katalon Studio, has support for more than 150 different technologies.
Practice Director - QA and SW Testing Services at a tech services company with 1,001-5,000 employees
MSP
2021-11-07T09:57:00Z
Nov 7, 2021
I've seen that our clients are not truly aware of the power behind Katalon. Many of the clients are now ready for the traditional Selenium, perhaps a more friendly layer like Cucumber or SpecFlow. But I think they will understand if we start doing automation with Katalon and they would be much more interested. The automation developers are starting to have really high demand and the salaries have increased, so with Katalon they might be interested in two things - the velocity of testing plus bringing manual testing to the automation world.
Senior Search Engineer at a financial services firm with 51-200 employees
Real User
2021-10-08T16:17:18Z
Oct 8, 2021
One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language. Other than that, we would want to see new features in every update. We would welcome any kind of improvement in terms of performance, etc.
Software Quality Assurance Engineer at a computer software company with 201-500 employees
Real User
2021-09-01T11:08:29Z
Sep 1, 2021
Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful. It is a bit slow. The other tools on my Mac are not slow, but Katalon is slow.
Technical Project Lead, Agile Coach, IT Educator at Asia Pacific College
Real User
2021-08-05T20:36:23Z
Aug 5, 2021
I believe it would a great feature if they could integrate JMETER and other performance testing tools so that Katalon would become an all-in-one test automation tool
Professional Services Manager at a non-profit with 201-500 employees
Real User
2021-05-11T12:06:22Z
May 11, 2021
The solution could always add more features. It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking. I'd like the integration with Jira to be a bit better. The pricing could be slightly improved.
Software Test Engineer at a tech services company with 1,001-5,000 employees
Real User
2020-10-21T04:33:56Z
Oct 21, 2020
It would be helpful if we could develop from scripts in other languages. For example Python. It would be more convenient than working with Jira and Java. For some of my colleagues who don't have the knowledge in the development, it is easier to work with Python rather than with Java. After two years of using this solution for free, we were limited in the features that we could use and had to start to pay for them. Now, we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time. I would like to see it integrate other tools other than Jira, and to have support in other development languages would be helpful.
There is not much support offered for the free version, which is something that could be improved. Support for more frameworks would be a really good addition to this tool
The free version of the solution is not user friendly at all. The solution's most valuable aspect is related to the record and playback. However, they need to improve the record and playback facility. TestComplete and UFT both have a much better record and playback functionality in comparison. It's one of the main reasons why I have, for example, inline tools, like UFT 5.0. They need to improve their object repository. The solution isn't as mature as TestComlete or UFT. Although they are continuously writing more functionalities, this is one area they really need to improve in. Technical support needs to be improved upon.
Programmer Analyst at a computer software company with 1,001-5,000 employees
Real User
2020-05-18T07:50:09Z
May 18, 2020
It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code. There is no centralized repository for documentation, which is something that would assist users.
We found that Katalon Studio crashes a lot of the time and it would be very good if it were more stable. When it crashes, the tests are not always saved and this means that you have to start again from scratch. It would be helpful to have an automatic save feature.
Test Lead at a financial services firm with 1,001-5,000 employees
Real User
2020-01-12T12:02:00Z
Jan 12, 2020
The maintenance of the tools can be improved. We have had some issues when it comes to stability i.e when project has lot of items in workspace, which is something that needs to be improved.
Lecturer and Researcher at a non-tech company with 10,001+ employees
Real User
2020-01-12T12:02:00Z
Jan 12, 2020
I really do not know what every user who is using this product might need to make it better for them. I do not think this is an easy question to answer for users globally. I do not think there are any features that we need. We had a small problem with an update of the web browser, but we managed to figure it out. New features are not part of our usage for the product. I think the one thing that is more problematic for the product is the online documentation. It could be more centralized and better or just easier to find.
Business Analyst at a consultancy with 10,001+ employees
Real User
2019-09-30T14:27:00Z
Sep 30, 2019
My recently-updated Katalon studio version hangs a lot and is not a stable version. The support system should be improved in many areas such as Katalon Studio forums and the Katalon community page, where developer responses take a lot of time to reply to user questions. Actually support response time is more than expected.
The browsing is messy. The solution tends to rush the tests on multiple processes. That doesn't work in most cases. They need to write a different script for the same test case on the cloud and another script to run the test on Firefox, for example. Also, in terms of reporting, in the documentation, it's mentioned that Katalon takes screenshots if the test case fails. But not on all test cases. I need to take screenshots manually. Often, running parallel test cases at the same time doesn't work. If it launches the first test case and it tries to launch the second test case at the same time, for example, the first test case will finish but the second will not stop. A lot of people are talking about this issue on the forums. The application is prone to freezing when it loads. Katalon doesn't support testing of hybrid applications. It's a limitation.
Senior Test Engineer at a tech services company with 51-200 employees
Real User
2019-07-29T10:11:00Z
Jul 29, 2019
At the moment, this solution only works for web-based products. It's sort of like a Selenium wrapper, which is quite well done. The Object Spy is rather frustrating to work with, so I tend not to use it. Instead, I just go and look at the objects in the HTML code, in Chrome for example. A more user-friendly Object Spy would be an improvement. I would like to see the extension to other GUIs such as Windows and SAP.
Katalon Studio is a regression testing tool that enables you to go low-code, boost productivity, and ease scalability. It is suitable for all platforms and operating systems, regardless of application complexity. The software is built on top of the open-source automation frameworks Selenium and Appium, with a specialized IDE interface for web, API, mobile, and desktop application testing. As a robust automation tool, Katalon Studio lets you run automated tests of UI elements, including...
I would like Katalon Studio to develop manual test case generation using AI capabilities, as other tools like those using OpenAI are already doing this. Also, enhancing its test management aspects and improving support levels with translators for non-English speakers would be beneficial.
It should be faster while executing, and there are some defects, like choosing the new device with the test case. Parallel execution is available, but not with the free version. The videos or training videos are not providing proper information on setup, and it should give more insights so everyone can understand.
There could be many improvements, however, I have not noted them down at this moment.
I would like to see improvements in how Katalon Studio works with iOS applications, especially with React Native applications. The speed is very slow. It takes time. Katalon Studio also takes my laptop memory, and execution becomes slow for the script. There are parallel execution options. I'm sure their online cloud version must be very fast, but as a service-based company, we are under NDA with our clients and can't run their code on our servers. I would like to see iOS improve and see a more capable recording feature. Katalon Studio has released an AI version, and I have a demo scheduled to see the new features.
Test report generation must be improved. It doesn’t fetch the right data. Even if we provide the proper screenshots, some are not fetched properly. HTML and PDF work fine. Sometimes, the client needs the report in Excel format. So, we skip the images because they are not properly implemented in Excel. Most clients know it. During parallel execution, some reports are randomly switched. We perform standalone switching to avoid such scenarios. The tool would be better if it improves object repository handling, Excel properties, serial execution, report generation, and scenario preparation.
Katalon Studio's pricing is expensive.
Speaking of the improvement required in Katalon Studio, I can say that in my company, we struggle a lot with iOS automation. For iOS apps, in my company, we struggle a lot since we set it all up on Mac, an area that can be improved. If Katalon Studio allows for more integrations with other test management and project management tools, it would be great since, right now, its integration capabilities are very limited.
The integration process with Jira should be enhanced and facilitated.
The product’s regression testing time could be reduced. The dashboards also take too much time to load. Additionally, its licenses are expensive. We have to purchase two licenses, including an enterprise license and a KRE license.
The product is comparatively slow. It is very slow when calling a test case within another test case and searching for it. The product is slow in the test case and execution. The product should be made more smooth and speedy.
They should include standard methods in AJAX controls for the solution.
The tool's maintenance is very difficult since they do not follow call by value or call by reference. Due to this, any change happening is not reflected throughout all the test cases. There are some issues with data parameterization as well.
We have been seeing some error pop-ups that are difficult to understand why they were triggered. In one of our applications, the solution is not able to recognize some of the elements making it unable to use with it.
What it lacks is the Selenium Grid capabilities.
Katalon Studio's support and service need to improve. They reply late and do not provide clear guidance, or a clear transition plan. The solution can be further improved with better loading time. In future releases, I would like to see the feature offered by their competitor included in Katalon. The competitors have image testing that captures a certain object on our website. Katalon would benefit by adding this feature.
We would like to see improved integration with various reporting tools; this would make our testing data more complete.
Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI.
Katalon lacks integration ability with other software, including integrating other languages like .NET and PHP. I've also had issues with new releases as the system often crashes and the previous version is no longer supported on a particular feature. More testing needs to be carried out before new versions are released. I'd like to be able to export our test system to any other product. This is currently not possible. Finally, the product only supports XPath and not CSS. CSS is faster than XPath and most companies want to use it. There are a lot of solutions on the market and if an end-user has too many problems with a product, they will jump to a new one.
One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area. For example, Tosca, in contrast to Katalon Studio, has support for more than 150 different technologies.
I've seen that our clients are not truly aware of the power behind Katalon. Many of the clients are now ready for the traditional Selenium, perhaps a more friendly layer like Cucumber or SpecFlow. But I think they will understand if we start doing automation with Katalon and they would be much more interested. The automation developers are starting to have really high demand and the salaries have increased, so with Katalon they might be interested in two things - the velocity of testing plus bringing manual testing to the automation world.
One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language. Other than that, we would want to see new features in every update. We would welcome any kind of improvement in terms of performance, etc.
Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful. It is a bit slow. The other tools on my Mac are not slow, but Katalon is slow.
I believe it would a great feature if they could integrate JMETER and other performance testing tools so that Katalon would become an all-in-one test automation tool
The solution could always add more features. It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking. I'd like the integration with Jira to be a bit better. The pricing could be slightly improved.
It would be helpful if we could develop from scripts in other languages. For example Python. It would be more convenient than working with Jira and Java. For some of my colleagues who don't have the knowledge in the development, it is easier to work with Python rather than with Java. After two years of using this solution for free, we were limited in the features that we could use and had to start to pay for them. Now, we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time. I would like to see it integrate other tools other than Jira, and to have support in other development languages would be helpful.
There is not much support offered for the free version, which is something that could be improved. Support for more frameworks would be a really good addition to this tool
The free version of the solution is not user friendly at all. The solution's most valuable aspect is related to the record and playback. However, they need to improve the record and playback facility. TestComplete and UFT both have a much better record and playback functionality in comparison. It's one of the main reasons why I have, for example, inline tools, like UFT 5.0. They need to improve their object repository. The solution isn't as mature as TestComlete or UFT. Although they are continuously writing more functionalities, this is one area they really need to improve in. Technical support needs to be improved upon.
It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code. There is no centralized repository for documentation, which is something that would assist users.
We found that Katalon Studio crashes a lot of the time and it would be very good if it were more stable. When it crashes, the tests are not always saved and this means that you have to start again from scratch. It would be helpful to have an automatic save feature.
The maintenance of the tools can be improved. We have had some issues when it comes to stability i.e when project has lot of items in workspace, which is something that needs to be improved.
I really do not know what every user who is using this product might need to make it better for them. I do not think this is an easy question to answer for users globally. I do not think there are any features that we need. We had a small problem with an update of the web browser, but we managed to figure it out. New features are not part of our usage for the product. I think the one thing that is more problematic for the product is the online documentation. It could be more centralized and better or just easier to find.
My recently-updated Katalon studio version hangs a lot and is not a stable version. The support system should be improved in many areas such as Katalon Studio forums and the Katalon community page, where developer responses take a lot of time to reply to user questions. Actually support response time is more than expected.
The browsing is messy. The solution tends to rush the tests on multiple processes. That doesn't work in most cases. They need to write a different script for the same test case on the cloud and another script to run the test on Firefox, for example. Also, in terms of reporting, in the documentation, it's mentioned that Katalon takes screenshots if the test case fails. But not on all test cases. I need to take screenshots manually. Often, running parallel test cases at the same time doesn't work. If it launches the first test case and it tries to launch the second test case at the same time, for example, the first test case will finish but the second will not stop. A lot of people are talking about this issue on the forums. The application is prone to freezing when it loads. Katalon doesn't support testing of hybrid applications. It's a limitation.
At the moment, this solution only works for web-based products. It's sort of like a Selenium wrapper, which is quite well done. The Object Spy is rather frustrating to work with, so I tend not to use it. Instead, I just go and look at the objects in the HTML code, in Chrome for example. A more user-friendly Object Spy would be an improvement. I would like to see the extension to other GUIs such as Windows and SAP.
I would like if this tool can work without any problems for React Native.