We are using it for load testing. We test other companies' programs.
Software Testing Services Manager at Virgosol
Free and not difficult to set up, but it is difficult to test APIs and model a test
Pros and Cons
- "We are using it just for load testing. We are using its free version, and it is scalable."
- "Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."
What is our primary use case?
What is most valuable?
We are using it just for load testing. We are using its free version, and it is scalable.
What needs improvement?
I am not satisfied with this solution. Its UI side is not so easy to use for beginners. It should be easier.
Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult.
For JSON, you can use tools such as JSONBuddy, but they are difficult to get in JMeter. It should be easy to get JSONBuddy from the website. I have to use BlazeMeter only to get JSONBuddy.
For how long have I used the solution?
It has been about five months.
Buyer's Guide
Apache JMeter
December 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
What do I think about the stability of the solution?
It is not so stable.
What do I think about the scalability of the solution?
It is scalable.
How are customer service and support?
Their support is fine. There are not many Apache documents, but you can find other documents on the web.
How was the initial setup?
It is not so difficult.
What's my experience with pricing, setup cost, and licensing?
We are using the free version.
What other advice do I have?
I would rate it a seven out of 10.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Executive Director/Consultant at a tech vendor with 1,001-5,000 employees
Cost-effective and has good community support
Pros and Cons
- "The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool."
- "There is some work to be done with the integration."
What is our primary use case?
In general, the primary use case of this solution is for performance testing and load testing.
Typically it is for load tests. They have to focus on three metrics including throughput, response times, and the utilization of the resources including the CPUs.
We are delivering some bank houses with performance tests, through JMeter.
The deployment model varies depending on the client. Some have a private line.
What is most valuable?
From the customers' perspective, the most valuable feature is the price.
The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool.
What needs improvement?
They have to find a way to prepare the script or to prepare a detailed analysis. We have to collect all the information on each of the services we have to call. Based on this they have to collect in the phase of preparation for the performance test and then we can run our audit. It is easy to prepare a script to run a performance test.
You can't rely on the support. It's something that is not fully working.
The scalability of this solution needs some improvement.
There is some work to be done with the integration.
For how long have I used the solution?
I have been using this solution for over five years.
What do I think about the stability of the solution?
This solution is stable, but it does have one limitation with the number of throughputs. For example, if I want to generate four, five, or two thousand people working concurrently then they have to prepare our setup for ten PC servers.
What do I think about the scalability of the solution?
Normally they can run a load for five thousand people, customers, or users working concurrently. It is scalable but needs some improvement.
How are customer service and technical support?
The technical support on the site is not fully functioning.
How was the initial setup?
The initial setup is easy and straightforward.
You can have it running within thirty minutes.
What about the implementation team?
I had always implemented this solution myself, but It's been a couple of years since I did it last.
Now it is done through our company technicians. I just coordinate activity-performance tests for our customers.
What's my experience with pricing, setup cost, and licensing?
This is an open-source solution, and there are no fees.
What other advice do I have?
The requirements for most of our customers is to provide them with cheap solutions, and most prefer not to pay for software. This is the right solution for them based on some of the open-source tools that are available.
There are some commercial solutions that provide better integration to the solutions that must be tested when running loads.
I would rate this solution an eight out ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Apache JMeter
December 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,067 professionals have used our research since 2012.
Test Engineer at mPHATEK System
Open-source solution with great RegEx extractor
Pros and Cons
- "JMeter's most valuable feature is the RegEx Extractor."
- "Running JMeter in GUI mode uses a lot of memory, which means we need to switch to a non-GUI mode when using a heavy load."
What is our primary use case?
I mainly use JMeter to check network capacity.
What is most valuable?
JMeter's most valuable feature is the RegEx Extractor.
What needs improvement?
Running JMeter in GUI mode uses a lot of memory, which means we need to switch to a non-GUI mode when using a heavy load. There's also a steep learning curve for how to use regular expressions.
For how long have I used the solution?
I've been using JMeter for over three months.
What do I think about the stability of the solution?
I would rate JMeter's stability seven out of ten.
What do I think about the scalability of the solution?
I would rate JMeter's scalability as six out of ten.
How was the initial setup?
The initial setup was very easy and took around five minutes.
What about the implementation team?
I implemented JMeter myself.
What's my experience with pricing, setup cost, and licensing?
JMeter is open source and available free of charge.
What other advice do I have?
I would recommend JMeter to other users as it's easy to use and open source, and overall, I'd rate it eight out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Director with 201-500 employees
Fast, user-friendly open-source testing tool
Pros and Cons
- "It is very quick and user-friendly."
- "If the solution was GUI based, I believe that it would be more versatile."
What is our primary use case?
I implement this solution for my clients.
What is most valuable?
It is very quick and user-friendly.
What needs improvement?
If the solution was GUI based, I believe that it would be more versatile.
For how long have I used the solution?
I have been using this solution anywhere from six to eight years.
What do I think about the stability of the solution?
The solution is stable, I would definitely recommend it to those who are considering it.
What do I think about the scalability of the solution?
The solution is scalable.
What's my experience with pricing, setup cost, and licensing?
No licensing is required as it is a free, open-source tool.
Which deployment model are you using for this solution?
Hybrid Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Amazon Web Services (AWS)
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Consultant at a tech services company with 10,001+ employees
It's very easy to download and setup the entire infrastructure.
Valuable Features:
Extremely light weight.
Very easy to download and setup the entire infrastructure (Controller +LGs)
Ease of scripting
Host of plugins which further boost its effectiveness
Availability Non-GUI mode which consumes even lesser resources than already lightweight GUI version.
Improvements to My Organization:
Robust scripts which could handle build changes
Easy LG(Master & Slaves) configuration setup
Very lightweight and low usage of resources
Room for Improvement:
GUI tends to freeze and shutdown under more load
Ctrl+z( Undo doesn't work) so gets very inconvenient at times
Cannot do a mass replace( Ctrl+H) on the GUI ( can do it if script is opened via notepad++)
Re-iteration problems during errors - Usually we have login in once only controller, Action in Loop controller and logout in once only controller. Now if an error comes when the user simply logouts due to some unhandled error then the script expects that your session would continue but if that error has made you logout then your next iterations won't go through and vice versa. Suppose you put everything in loop controller and error doesn't log you out then the script start to login when you are already logged in and tends to fail.
Deployment Issues:
We've had no issues with deployment.
Stability Issues:
See above Room for Improvement.
Scalability Issues:
We've had no issues with scalability.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Sr Manager - Quality Engineering at a computer software company with 501-1,000 employees
Great performance testing for applications with a valuable load testing feature
Pros and Cons
- "We find the load testing feature valuable."
- "The reporting section of the solution can be better."
What is our primary use case?
Our primary use case for the solution is performance testing for applications, and we deploy it on the cloud and on-premises.
What is most valuable?
We find the load testing feature valuable.
What needs improvement?
The reporting section of the solution can be better. Additionally, more plugins can be included in the next release.
For how long have I used the solution?
We have been using the solution for approximately 15 years and are currently using version 5.3.
What do I think about the stability of the solution?
The solution is stable.
What do I think about the scalability of the solution?
The solution is scalable, but it all depends on the application. However, it is usually scalable by up to 2500 users. However, if you want to use it for any number of users, you can use JMeter as long as your machine supports it.
How are customer service and support?
We do not have experience with customer service and support because everything is stable.
Which solution did I use previously and why did I switch?
We previously used LoadRunner.
How was the initial setup?
The initial setup is straightforward. I rate it a nine out of ten.
What's my experience with pricing, setup cost, and licensing?
The tool is open source, so we do not pay for licensing.
What other advice do I have?
I rate the solution a nine out of ten. I advise new users to enhance their understanding of the solution via Youtube.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Quality Assurance Engineer at a consultancy with 501-1,000 employees
Is widely used and has free plugins and features
Pros and Cons
- "We like that Apache JMeter has different features and different plugins and that they are free of charge."
- "Report generation needs to be improved. It is quite difficult to get to."
What is our primary use case?
We use it to measure the performance of the system and for balancing.
What is most valuable?
We like that Apache JMeter has different features and different plugins and that they are free of charge.
We also like that lots of people use it. So, if we happen to get stuck at some point, then we can search for solutions on Google and find them.
What needs improvement?
Report generation needs to be improved. It is quite difficult to get to.
For how long have I used the solution?
We've been using Apache JMeter for two years.
What do I think about the stability of the solution?
It is quite stable.
What do I think about the scalability of the solution?
It is a scalable solution.
What other advice do I have?
On a scale from one to ten, I would rate Apache JMeter at nine. I would recommend it for medium-sized businesses.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Sr. Performance Test Engineer at a university with 501-1,000 employees
It can record, run, and create reports, but it hangs up on large loads.
Valuable Features:
I like the ease of using JMeter. It can be downloaded and can be used to record and run load tests. JMeter can record, run and create reports easily without the need to have licenses, complex installations and paid support. It can be used to performance test services, web applications, database queries, LDAP, etc.
Improvements to My Organization:
We use JMeter for performance testing. We are able to know which module is lagging behind in performance, whether the software or hardware upgrades have improved the performance or not.
Room for Improvement:
I think JMeter hangs up on large loads. I have seen JMeter becoming unresponsive in the middle of a test. It is because of garbage collection in JMeter. We use best practices to mute all listeners, use non GUI mode, etc., but even with many best practices JMeter pauses in between load tests.
Cost and Licensing Advice:
It is a open source tool.
Other Advice:
My advice would be to have load generator machines. Do not run JMeter (or any load testing tool) from a desktop. Do not have just one JMeter installation to generate load. Use several JMeter instances to distribute load. If possible, use JMeter in Client Server mode.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Hello Rahul,
If in 2017 using JMeter 3.1 you still experience "hangs up on large loads." as you wrote here then it would be really nice to report this issue to JMeter team:
- jmeter.apache.org
From my experience with it, I am able since JMeter 2.11 at least to load test with a single JVM on a 8 Core machine with 6g of memory to load test without any issue up to 2000/2500 Threads with a correctly developed test plan. And whenever I switch to distributed load testing run load test on big E-Commerce website with Millions of users per day.
So I am very interested to know what kind of issue you face so that we can either help you to fix your test plan or fix the issue in JMeter if it is there.
Thank you
Philippe M. from Apache JMeter Team and big user of Apache JMeter
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros
sharing their opinions.
Updated: December 2024
Popular Comparisons
Tricentis NeoLoad
Perfecto
OpenText LoadRunner Professional
BlazeMeter
OpenText LoadRunner Cloud
OpenText LoadRunner Enterprise
ReadyAPI
Oracle Application Testing Suite
Eggplant Performance
RadView WebLOAD
Akamai CloudTest
SmartBear LoadNinja
IBM Rational Test Workbench
HCL OneTest
Automai AppLoader
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- Jmeter vs SOAtest?
- How does Postman compare with Apache JMeter?
- How does BlazeMeter compare with Apache JMeter?
- What is your experience with Citrix with JMeter?
- When evaluating Load Testing Tools, what aspect do you think is the most important to look for?
- SOAtest vs. SoapUI NG Pro?
- Does Compuware have a manual testing solution? Which manual testing solutions should we be considering?
- What are the top performance tools available to load test web applications?
- What is the best tool for mobile native performance testing on real devices?
- When evaluating Performance Testing Tools, what aspect do you think is the most important to look for?
Hello Kapil,
Thank you for your review.
Here are my comments on what you write:
- GUI tends to freeze and shutdown under more load => Load testing with GUI is a known ANTI-PATTERN. GUI is to create/record/correlate, NON GUI is for Load Testing. Since 3.1 a WARNING appears on startup.
- Ctrl+z( Undo doesn't work) so gets very inconvenient at times => True, we'll try to find a solution to this
- Cannot do a mass replace( Ctrl+H) on the GUI ( can do it if script is opened via notepad++) => With upcoming 3.2, you'll be happy to see this feature
- I don't understand the last item, so if you're willing to give more details maybe we can help on this, see jmeter.apache.org
Thank you
Regards
Philippe M. from Apache JMeter Team