I use the solution in our organization for load testing.
Quality Analyst at Hiup Solution
A stable and scalable solution useful for load testing
Pros and Cons
- "Due to process automation, I don't have to prepare reports, making it the perfect solution."
- "At times when we overload the application, it gets stuck...After the solution gets stuck due to overloading, we have to restart our computers. In short, the solution keeps crashing."
What is our primary use case?
What is most valuable?
The solution's automation capabilities are one of the best parts of the solution. Due to process automation, I don't have to prepare reports, making it the perfect solution. Whenever I require a report, the report gets generated by the solution, and then afterwards, I can look at the reports before copying and pasting them.
What needs improvement?
At times when we overload the application, it gets stuck. Especially with load testing, it gets stuck when we deal with huge numbers of 100 to 1,000-10,000 or 2,000 to 20,000. I believe that we should be able to hit around a million people without any issues. After the solution gets stuck due to overloading, we have to restart our computers. In short, the solution keeps crashing.
For how long have I used the solution?
Apache JMeter is a simple solution, and I have been using it for seven years. Also, I am using the solution's latest version.
Buyer's Guide
Apache JMeter
December 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
What do I think about the stability of the solution?
After an update in the application, the stability gets hampered if we continue to use its non-updated version, causing the solution to crash. So, once I faced that problem since I was not updating the application, it crashed. Back then, I wasn't aware that an update was available for the solution, which I had to apply to the solution. So, for two or three days, I tried to solve the issue with the solution. Later, I found that I just needed to update the application. So, after I updated the application, it started working fine. I rate the solution's stability a seven out of ten.
What do I think about the scalability of the solution?
Since Apache JMeter is a scalable product, I rate the solution a ten out of ten. I am the only person using the solution in my organization.
How are customer service and support?
Since I have experience with the solution's customer support team, I rate the technical support of the solution an eight out of ten.
How would you rate customer service and support?
Positive
How was the initial setup?
On a scale of one to ten, where one is difficult, and ten is easy, I rate the solution's initial setup a ten out of ten.
The solution's deployment process took only a couple of hours. I believe it took me around an hour or so at the beginning during the initial setup phase. Right now, I can deploy the solution in fifteen to twenty minutes.
Maintenance for the application is only required when the application crashes due to its overuse.
What's my experience with pricing, setup cost, and licensing?
Since we are using an outsourced solution, it is not paid for by our company.
What other advice do I have?
My words to those planning to use the solution is that if the crashing issues in the solution get resolved, it is one of the perfect solutions in the market. Also, I have not used the paid version, so I have no idea how it works. It's a very resourceful solution.
I need to use the paid version to be able to comment on it. Since we are using the free version in a company, even if the solution makes any mistakes, we ignore those and go ahead.
Overall, I rate the solution a ten out of ten.
Which deployment model are you using for this solution?
Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Technology Competency and Solution Head at LearningMate
It is easily deployable and extendable, but it should start supporting the presentation layer
Pros and Cons
- "It is open source as well as relatively extendable. It allows us to extend and add additional functionality and features. Its deployment is also very easy."
- "It should start supporting the presentation layer. It currently provides performance testing specifically at the application and API level. It can be extended to the presentation layer, which includes mainly Angular and React frameworks. It should also be easy to use and easy to train people."
What is our primary use case?
It is specifically used for performance systems. It is used for identifying the areas where we need to improve the application bottlenecks and for load testing. We are using its latest version.
How has it helped my organization?
It has helped us to build robust application cater to the learning domain and identify bottleneck prior go live. It helped us refine our deployment strategy and capacity planning.
What is most valuable?
It is open source as well as relatively extendable. It allows us to extend and add additional functionality and features. Its deployment is also very easy.
What needs improvement?
It should start supporting the presentation layer. It currently provides performance testing specifically at the application and API level. It can be extended to the presentation layer, which includes mainly Angular and React frameworks.
It should also be easy to use and easy to train people.
For how long have I used the solution?
I have been using this solution for more than ten years.
What do I think about the stability of the solution?
It is stable.
What do I think about the scalability of the solution?
It is scalable. It allows us to extend and add additional functionality and features.
We have around 10 to 15 people who use this solution.
How are customer service and technical support?
It is open source, so I don't think any support is available.
Which solution did I use previously and why did I switch?
Load Runner, replaced with JMeter due to lower ROI
How was the initial setup?
Its deployment is easy. It didn't take much time. It took less than 15 minutes.
What about the implementation team?
We deployed it on our own.
What was our ROI?
1. Scalable Product and solutions
2. Plug and Play with CICD process
3. Reduction in licence cost
What's my experience with pricing, setup cost, and licensing?
No Licensing cost for JMeter
Which other solutions did I evaluate?
Yes.
What other advice do I have?
I would recommend this solution. We plan to keep using this solution.
I would rate Apache JMeter a seven out of ten.
Which deployment model are you using for this solution?
Private Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Apache JMeter
December 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
Presales manager at Mitra Innovation
Easy to set up with good documentation but needs extended backend support
Pros and Cons
- "It's stable and reliable."
- "In terms of platform support, they need to extend the support for backend platforms and more of the legacy types of platforms."
What is our primary use case?
There's a third-party platform that is getting migrated to, so with the newer version migration, we were looking to see if there are any performance degradation with the migration. The product platform assures the user loads that we are planning to have on the system. Nevertheless, we wanted to have validation from a business perspective. We wanted to see that it'll still support the loads that we are looking at.
What is most valuable?
The ability to create a large number of user loads has been very helpful for us.
It's typically straightforward to set up.
The solution can scale well.
It's stable and reliable.
There is lots of useful community support.
What needs improvement?
In terms of platform support, they need to extend the support for backend platforms and more of the legacy types of platforms.
For how long have I used the solution?
We've used the solution for a long while. We've used it for a few years.
What do I think about the stability of the solution?
It's a well-trusted product. A lot of people use it. There's a lot of support in the community also. Therefore, the stability is pretty good and it is quite reliable.
What do I think about the scalability of the solution?
We can create demand as we need. It's quite scalable.
We have five people suing the product. The performance testers use it.
How are customer service and support?
We can get a lot of support from the community. It's pretty easy to get assistance.
We've had no issue so far when we've needed to get help. We are satisfied with the support.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We did not previously use a different solution.
How was the initial setup?
The solution can be easy to set up depending on the target system that we are testing. However, there are situations where Apache JMeter is not supported.
The deployment took two to three weeks to set up and deploy.
We have a team of five people that can handle deployment and maintenance.
What about the implementation team?
We did the setup in-house. We have the capabilities within.
What's my experience with pricing, setup cost, and licensing?
Most of the time, it's the end client who manages the license for us. We don't purchase the product by ourselves; it's the end customer who does it for us. I'm not sure what the actual cost of the product is.
What other advice do I have?
We likely are using the latest version of the solution. However, I can't be sure. I'm not sure which version number we're using.
It's a tool that is being used by many, many others as well. There's a lot of community support out there. I'd recommend it, as long as it supports the platform.
I'd rate the solution seven out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Software Solution Architect at Beltone Financial
Helps in the capacity assessment planning for services
Pros and Cons
- "The product helps me get the expected performance from applications or servers and reduces costs. It also enhances the performance of the services and helped them reach their ultimate capacity."
- "The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways."
What is our primary use case?
The tool helps us in the capacity assessment planning for our services. It helps us to make sure that the APIs will be able to afford the traffic that we expect to get from these services in the production environment.
How has it helped my organization?
The product helps me get the expected performance from applications or servers and reduces costs. It also enhances the performance of the services and helped them reach their ultimate capacity.
What needs improvement?
The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways.
For how long have I used the solution?
I have been using the solution for more than three to four years.
What do I think about the stability of the solution?
The tool is stable.
What do I think about the scalability of the solution?
The product is scalable. My company has around four to five users for the solution.
How was the initial setup?
The product's setup is not complex. The tool's installation was very smooth. It doesn't have any deployment process. You just need to implement a set of packages to get started with the product.
What other advice do I have?
I would rate the product an eight out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Director Consulting Expert at a computer software company with 10,001+ employees
Great features, reliable over the years, with accuracy in overall performance
Pros and Cons
- "The distributed load testing is very good with Apache JMeter."
- "The initial setup is complex and needs to be upgraded."
What is most valuable?
The distributed load testing is very good and the ramp-up. When we come out with the right ramp-up plan, it can be converted into Apache JMeter script very well. This accurately simulates how many of our transactions need to be triggered.
What needs improvement?
I would like to see exceptions improved. The initial setup is complex and needs to be upgraded. It would be great to have additional protocols other than HTTP, HTTPS, and APIs.
For how long have I used the solution?
I have been working with Apache JMeter for the past seven years.
What do I think about the stability of the solution?
The stability is good and I am not finding any issues.
What do I think about the scalability of the solution?
We are not having any problems with the scalability of Apache JMeter
How are customer service and support?
Technical support is very good.
How would you rate customer service and support?
Positive
How was the initial setup?
The initial setup is complex.
What's my experience with pricing, setup cost, and licensing?
Apache JMeter is a free tool.
What other advice do I have?
I would rate Apache JMeter a nine out of ten.
Which deployment model are you using for this solution?
Hybrid Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Other
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Software Test Engineer at Loyal Hospitality Pvt. Ltd
Good performance testing and reporting, helpful user community, but it hangs with too many concurrent threads
Pros and Cons
- "The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good."
- "Automation is difficult in JMeter."
What is our primary use case?
We use Apache JMeter for lower-end performance testing. Sometimes we use it for Rest API testing, as well.
How has it helped my organization?
This solution allows us to have a detailed look at performance using different metrics. We can look at the deviation and the median values and see how it is performing. We can also analyze our servers and see how they are performing in terms of CPU and how much memory is allocated.
What is most valuable?
The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good.
The plugin for git allows us to scan files directly from the GitHub site.
The reporting is good and there are a lot of different formats available.
If you want to see the data that is associated with a response then you can download it in JSON format.
There is a large user community that can help you to learn and use JMeter.
What needs improvement?
When we are testing with too many threads then the solution hangs.
JMeter does not support JavaScript.
Automation is difficult in JMeter.
For how long have I used the solution?
We have been using JMeter for the past two years.
What do I think about the stability of the solution?
Stability becomes an issue if we use more than 10 or 20 threads.
How are customer service and technical support?
We have not been in contact with Apache technical support.
There is a large user community and if you need help then you can get instant help from them.
Which solution did I use previously and why did I switch?
We also use Postman and when it comes to making a very large request, it is the better option. It is also a user-friendly solution and you do not have to go through a lot of documents to start using it.
JMeter works better for iterative testing.
How was the initial setup?
It is easy to set up and administer JMeter.
What's my experience with pricing, setup cost, and licensing?
This is an open-source product.
What other advice do I have?
This is a good solution but many features would have to be added to use this tool alone. Postman has more features, so JMeter is really only good for performance testing.
I would rate this solution a seven out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Sr Manager - Quality Engineering at a computer software company with 501-1,000 employees
A useful solution for load testing and testing web applications, but it does not provide page rendering capabilities for end-users
Pros and Cons
- "When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution."
- "Self-healing and page rendering for the end-users are not available in Apache JMeter."
What is our primary use case?
The solution is primarily used for load testing.
How has it helped my organization?
When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution. Also, we can even increase the number of users using it.
What is most valuable?
All the features mentioned under JMeter metrics are available to use. Feature-wise, the solution has everything in it that I want.
What needs improvement?
Self-healing and page rendering for the end-users are not available in Apache JMeter. Hence, these are the two areas that need to be made available in future releases of the solution.
For how long have I used the solution?
I have been using Apache JMeter for eight years. Also, I am using the solution's latest version, and any of the solution's versions support all the applications in my organization. Our company is an end-user of the solution.
What do I think about the stability of the solution?
Stability-wise, I rate the solution a seven out of ten.
What do I think about the scalability of the solution?
There are around 50,000 users in my company using the solution. Also, most of the users are involved in performance testing. Scalability-wise, I rate the solution a seven out of ten.
With Apache JMeter, banking processes may face some scalability issues.
How are customer service and support?
There is no support at all for the solution. Basically, it provides zero support.
How was the initial setup?
The solution's initial setup process was straightforward since one only needs to download Apache JMeter and use it after that. Basically, there is no need to do any installation.
There is no need for any maintenance in the solution since it is an open-source product.
What's my experience with pricing, setup cost, and licensing?
Since it is an open-source product, buying or paying for any license is unnecessary. One just needs to download it to be able to use it.
What other advice do I have?
I would recommend the product to those planning to use it as an open-source product, and there is no need to buy a license. So, it is free of cost application. However, I am not sure about the product from a security perspective. But nowadays, banking people are also using it, but it won't be scalable in a banking environment where a large number of people want to use it. Using the solution, one can only test web applications and not use the tool for page rendering. I rate the overall solution a seven out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Delivery Manager at a tech services company with 10,001+ employees
Plenty of features, straigthforward installation, but reports could improve
Pros and Cons
- "The most valuable feature of Apache JMeter is its popularity. It is the best open-source tool with all the features needed."
- "The reports in Apache JMeter could improve."
What is our primary use case?
We are using Apache JMeter for automation and for processing activities of our clients. Additionally, it is used for testing.
What is most valuable?
The most valuable feature of Apache JMeter is its popularity. It is the best open-source tool with all the features needed.
What needs improvement?
The reports in Apache JMeter could improve.
For how long have I used the solution?
I have been using Apache JMeter for approximately one and a half years.
What do I think about the stability of the solution?
The stability of Apache JMeter is good.
What do I think about the scalability of the solution?
Apache JMeter is scalable.
We have less than five people using this solution in my organization.
How are customer service and support?
There is a lot of support available that is good, such as in forums. However, they do not have a dedicated team that you can contact.
Which solution did I use previously and why did I switch?
I have not used a solution previously.
How was the initial setup?
Apache JMeter was straightforward to install.
What's my experience with pricing, setup cost, and licensing?
The price of Apache JMeter is good. The selling rate is quite effective and the limited users with a multi-region-related execution.
What other advice do I have?
My advice to others is to go through some basic video processes, which are available on YouTube and Apache JMeter site, it has a lot of documentation that will help you get prepared and used to the tool.
I rate Apache JMeter a seven out of ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Amazon Web Services (AWS)
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros
sharing their opinions.
Updated: December 2024
Popular Comparisons
Tricentis NeoLoad
Perfecto
OpenText LoadRunner Professional
BlazeMeter
OpenText LoadRunner Cloud
OpenText LoadRunner Enterprise
ReadyAPI
Oracle Application Testing Suite
Eggplant Performance
RadView WebLOAD
Akamai CloudTest
SmartBear LoadNinja
IBM Rational Test Workbench
HCL OneTest
Automai AppLoader
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- Jmeter vs SOAtest?
- How does Postman compare with Apache JMeter?
- How does BlazeMeter compare with Apache JMeter?
- What is your experience with Citrix with JMeter?
- When evaluating Load Testing Tools, what aspect do you think is the most important to look for?
- SOAtest vs. SoapUI NG Pro?
- Does Compuware have a manual testing solution? Which manual testing solutions should we be considering?
- What are the top performance tools available to load test web applications?
- What is the best tool for mobile native performance testing on real devices?
- When evaluating Performance Testing Tools, what aspect do you think is the most important to look for?