We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable feature of this solution is that it is free."
"Apache JMeter is stable."
"Scripting with the solution is good."
"It is very quick and user-friendly."
"JMeter lets us generate virtual users and T-load, per our requirements. It's easy to configure and adjusting the virtual users according to the DPS we want to achieve."
"It's a free tool."
"The most valuable features are the integration with Jenkins and the reporting."
"We are using it just for load testing. We are using its free version, and it is scalable."
"The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"I rate Katalon Studio's scalability a four out of five."
"The ability to build all libraries with codes and use them in many situations has been most valuable."
"It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
"This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
"The most important feature is the Jenkins integration; it is pretty straight forward and allows us to run nightly builds."
"The product provides ease of automation for the cloud."
"The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways."
"Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script."
"It should be easier to combine multiple scripts. If you have multiple scripts, you need to write a new script to combine those scripts. The virtual user generator is slow."
"Its reporting could be improved. There should be a better visual representation. That would be helpful for easy consumption of the reports."
"The solution needs more metrics for reporting."
"In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."
"JMeter is lagging when it comes to GUI performance testing because we need to install some third-party plugins for recording the GUI script, and the performance isn't very reliable."
"The interface could be made more user-friendly."
"The price of Katalon Studio is an area of concern where improvement is required."
"The free version of the solution is not user friendly at all."
"One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
"They need to work on documentation to make it more centralized and easier to find what you are looking for."
"Now we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time."
"We have been seeing some error pop-ups that are difficult to understand why they were triggered."
"My recently-updated Katalon studio version hangs a lot and is not a stable version."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.