Try our new research platform with insights from 80,000+ expert users
reviewer1381095 - PeerSpot reviewer
Quality Assurance Test Manager at a printing company with 5,001-10,000 employees
Real User
Cost-effective and straightforward to deploy, but the reporting needs to be improved
Pros and Cons
  • "The recording and playback functionality is helpful."
  • "The reporting is not very good."

What is our primary use case?

When I was last using JMeter, we were simulating 200 concurrent users and evaluating performance based on transaction times. We were defining SLAs based on the results.

Essentially, we created load scenarios and testing different ones using different workload models.

What is most valuable?

The recording and playback functionality is helpful.

What needs improvement?

The reporting is not very good.

When we run with multiple users, it takes a lot of memory.

With respect to the recording and playback functionality, the auto-correlation parameterization is not easy and should be improved.

For how long have I used the solution?

I have been using Apache JMeter for about four years.

Buyer's Guide
Apache JMeter
November 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
816,406 professionals have used our research since 2012.

What do I think about the stability of the solution?

There are issues with stability when running with multiple users because it consumes a lot of memory.

What do I think about the scalability of the solution?

Scalability is fine, although it is important to remember that JMeter doesn't run on its own. It needs to work with load-generations such as BlazeMeter. LoadRunner is the same in that you need a cloud-based infrastructure to run it.

How are customer service and support?

There is no official support. There is a forum where you can ask questions and they respond to you, but the technical support that we have with LoadRunner or NeoLoad is not available.

Which solution did I use previously and why did I switch?

I have used many similar solutions in the past such as New Relic, AppDynamics, NeoLoad, and Micro Focus LoadRunner Enterprise.

JMeter is not as good as LoadRunner or NeoLoad, and it isn't as easy to use, but it's okay because there is no cost. LoadRunner is too expensive, in my opinion. NeoLoad is cheaper, although not significantly.

From what I have seen, many companies are adopting JMeter because it's free. Especially in Canada, using JMeter seems to be the new trend. Some companies are choosing NeoLoad over LoadRunner because it is easier, faster, and cheaper. Whatever they need to do can be completed quicker. The main problem with NeoLoad is that obtaining resources is harder.

Given all of the choices, my preference would be to implement NeoLoad.

How was the initial setup?

The initial setup is straightforward. I would not say that it is complex and if you already have the file downloaded then it will only take about half an hour to deploy.

What about the implementation team?

I took care of the deployment myself.

What's my experience with pricing, setup cost, and licensing?

I was using the free version of the software.

What other advice do I have?

My advice for anybody who is considering JMeter is to just install it and try it. Creating scripts is a different process when you compare it to LoadRunner or Neoload. There is different terminology compare to these two products, so if somebody has not used JMeter then it may seem difficult at first.

I would rate this solution a six out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Sr Manager - Quality Engineering at a computer software company with 501-1,000 employees
Real User
Top 5
A useful solution for load testing and testing web applications, but it does not provide page rendering capabilities for end-users
Pros and Cons
  • "When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution."
  • "Self-healing and page rendering for the end-users are not available in Apache JMeter."

What is our primary use case?

The solution is primarily used for load testing.

How has it helped my organization?

When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution. Also, we can even increase the number of users using it.

What is most valuable?

All the features mentioned under JMeter metrics are available to use. Feature-wise, the solution has everything in it that I want.

What needs improvement?

Self-healing and page rendering for the end-users are not available in Apache JMeter. Hence, these are the two areas that need to be made available in future releases of the solution.

For how long have I used the solution?

I have been using Apache JMeter for eight years. Also, I am using the solution's latest version, and any of the solution's versions support all the applications in my organization. Our company is an end-user of the solution.

What do I think about the stability of the solution?

Stability-wise, I rate the solution a seven out of ten.

What do I think about the scalability of the solution?

There are around 50,000 users in my company using the solution. Also, most of the users are involved in performance testing. Scalability-wise, I rate the solution a seven out of ten.

With Apache JMeter, banking processes may face some scalability issues.

How are customer service and support?

There is no support at all for the solution. Basically, it provides zero support.

How was the initial setup?

The solution's initial setup process was straightforward since one only needs to download Apache JMeter and use it after that. Basically, there is no need to do any installation.

There is no need for any maintenance in the solution since it is an open-source product.

What's my experience with pricing, setup cost, and licensing?

Since it is an open-source product, buying or paying for any license is unnecessary. One just needs to download it to be able to use it.

What other advice do I have?

I would recommend the product to those planning to use it as an open-source product, and there is no need to buy a license. So, it is free of cost application. However, I am not sure about the product from a security perspective. But nowadays, banking people are also using it, but it won't be scalable in a banking environment where a large number of people want to use it. Using the solution, one can only test web applications and not use the tool for page rendering. I rate the overall solution a seven out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Apache JMeter
November 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
816,406 professionals have used our research since 2012.
reviewer1279800 - PeerSpot reviewer
Technical Specialist at a financial services firm with 10,001+ employees
Real User
Reasonably priced, performs well, and has responsive technical support
Pros and Cons
  • "It is cost-effective and simple to use."
  • "It will be much easier, and beneficial for the individual to run it on their own machines rather than having a high-end infrastructure, more CPUs, or more memory that has been consumed by Apache JMeter."

What is our primary use case?

Regardless of, whether it is used for personal performance, load, volume, UI test, or functional test Apache JMeter is the best tool on the market.

What is most valuable?

It is cost-effective and simple to use.

Take, for example, a performance test with, the Micro Focus performance test tool, and compare it to Apache JMeter. Apache JMeter is far less expensive than HP Performance Center.

What needs improvement?

When you run tests with JMeter, it generates test version five, which is extremely large. Also, when you have a large number of tests to run, it requires a large size or memory size, which basically means it consumes a lot of memory. It would be helpful to come up with a way to be able to use Apache JMeter in a way where it did not use as much memory. It will be much easier, and beneficial for the individual to run it on their own machines rather than having a high-end infrastructure, more CPUs, or more memory that has been consumed by Apache JMeter.

For how long have I used the solution?

I have been working with Apache JMeter for two years now.

I am working with the latest version.

It's on digital platforms rather than the cloud.

What do I think about the stability of the solution?

I am absolutely satisfied with the stability of Apache JMeter.

What do I think about the scalability of the solution?

Apache JMeter is a scalable product. We are pleased with the scalability of this solution.

How are customer service and support?

When we have encountered difficulties and reached out to technical support, they respond very quickly and most of the things are readily available with them, for all of the challenges or support that are required. If I had to rate them from one to ten, I would rate the technical support an eight out of ten.

How would you rate customer service and support?

Positive

How was the initial setup?

It is very easy to set up. There have been no issues, it's hassle-free, and it doesn't require a lot of expertise or specialization to configure and set up JMeter. 

It is very straightforward and very easy. That is something that anyone can do.

What about the implementation team?

Our team completed the deployment. It only requires one person and takes no more than two to four hours.

In terms of maintenance, we only require one person.

What was our ROI?

When you compare it to HP because prior to using this Apache JMeter, we used this HP Performance Center, and in terms of ROI, while I don't have exact figures, when it comes to HP Performance Center, we have nearly five times more. You can say that it's five times less of an investment and five times written on the investment by using Apache JMeter. With Apache JMeter, you receive five times more. It's higher.

What's my experience with pricing, setup cost, and licensing?

It's a yearly license.

What other advice do I have?

I would rate Apache JMeter an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1451502 - PeerSpot reviewer
Quality Engineering Delivery Leader at a financial services firm with 10,001+ employees
Real User
Good performance and easy to configure but could use better UI
Pros and Cons
  • "The performance of the solution is excellent."
  • "You really need a technical team in order to really utilize the product."

What is our primary use case?

We're primarily using the solution for its performance. It's on our data center.

How has it helped my organization?

The tool has been a great help to our organization, which is focused more on quality testing as opposed to performance testing. It's provided a lot of insights. With the digital transformation that is currently happening, the need for that shift was rather critical.

What is most valuable?

The performance of the solution is excellent.

They have designed the product so that it is very easy to configure. 

You can basically do anything you like with the product. It's not very restrictive.

We like the fact that the technology is open-source.

What needs improvement?

The user interface could be improved. If they had better UI, it might make it easier to use.

You really need a technical team in order to really utilize the product.

The scalability could be better, or the process of scaling itself could be a bit more clear.

For how long have I used the solution?

We've used the solution for a couple of years at this point.

What do I think about the stability of the solution?

The stability is quite good. There haven't been any issues with bugs or glitches. It doesn't crash of freeze. It's very reliable.

What do I think about the scalability of the solution?

Nobody ever has used any tool to its full capacity, including this one. Half of the time it's how you set up and how your environment is. We can easily scale on cloud. So far, we're worried about its ability to scale. Our setup is basically a hybrid cloud where we can have private data centers and we can know exactly where each is located. However, the scaling is a big concern for me. I'm looking at BlazeMeter as well, and, although I've only really read about it, it looks like it scales quite well. With scaling, I'm sure I'll find more complexities, especially if I look into kiosk testing. I'll want to explore further test cases.

Currently, those that are on the product are mostly testing communities approaching it from a performance aspect. Every project is different and therefore the number of users goes up and down.

How are customer service and technical support?

There isn't really a need for tech support with JMeter. There is a vibrant community, which is a good way for a lot of users or developers to go on and post a question and get an answer. The team prefers it this way. It's a positive aspect of JMeter.

Which solution did I use previously and why did I switch?

I have some experience LoadRunner, however, it is expensive for what it offers. This product is open-source which makes it affordable.

How was the initial setup?

The initial setup is pretty straightforward. My team was very hands-on. They didn't struggle with the UI at all and it wasn't too complex for them. That said, if a person with lesser skill levels, maybe someone who has a lower skillset, may struggle a bit with the implementation. It's geared slightly towards more technical users.

What's my experience with pricing, setup cost, and licensing?

The product is an open-source solution.

Which other solutions did I evaluate?

I understand the Apache also has something called BlazeMeter, which is something I recently looked into.

What other advice do I have?

I'm not quite sure which version of the solution our team is using right now. It's likely the latest version. We did the upgrade on our tools in 2019. It's open-source, and therefore everybody picks up the latest one.

As an open-source tool, there's a good community surrounding it. If you have automation frameworks or a DevOps pipeline, you can connect that and easily configure everything to streamline processes. Due to the fact that it's open-source, you don't have to wait to get the approvals and the budgets in order. That part alone can take months to sometimes years. If your company has the time, they should review the tools. If it seems to fit your organization, I'd recommend trying it out. 

Overall, I would rate the solution seven out of ten. It's a good open-source tool that you can configure easily, and it's very competitive in the market in terms of usability

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer2272365 - PeerSpot reviewer
Sr QA Manager at a tech services company with 51-200 employees
Real User
Top 10Leaderboard
Performance and flexibility enhanced by robust reporting and seamless integrations
Pros and Cons
  • "It's very useful for performance and load testing."
  • "Some features still require a certain knowledge level to use effectively, and making these features more user-friendly would be beneficial."

What is our primary use case?

We engage in performance testing using JMeter based on the client's requirements. We decide the endpoints for JMeter based on the domain and application requirements. The requirements, like 50 users per minute or 500 users per hour, guide our performance testing framework.

How has it helped my organization?

JMeter has allowed us to effectively verify that, based on pre-requirements, performance standards are met. Since it's an open-source tool, it also allows us to reduce the expenditure on performance testing tools.

What is most valuable?

The different listeners in JMeter provide various reports and results. It's very useful for performance and load testing. Its compatibility with external tools, such as the ability to import scripts from Selenium and Azure DevOps, makes it a robust and flexible option.

What needs improvement?

I would recommend the inclusion of plugins for AI in JMeter. Some features still require a certain knowledge level to use effectively, and making these features more user-friendly would be beneficial.

For how long have I used the solution?

I have not been a direct team member but have managed a team working on JMeter for almost eleven years. In my nineteen years of experience, I have engaged with performance testing, with JMeter being part of our toolkit.

What do I think about the stability of the solution?

Stability is not a concern for expert users of JMeter. However, stability can be an issue for beginners.

What do I think about the scalability of the solution?

JMeter is widely used and very scalable, rated between eight and nine in terms of scalability. It can also integrate with cloud solutions like Microsoft Azure.

How are customer service and support?

There are many online blogs, forums, and video tutorials available for JMeter, providing substantial support for both beginner and intermediate levels.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

LambdaTest and BrowserStack were part of our working user experience, but not extensively more than that. I initially worked with other performance testing tools like LoadRunner.

How was the initial setup?

The setup for JMeter is very easy. There is no installation required; it is simply a package that needs to be imported and can be set up within half an hour or less, depending on the download speed.

What was our ROI?

Our clients cover the necessary licensing costs, particularly when using cloud services like Microsoft Azure.

What's my experience with pricing, setup cost, and licensing?

JMeter itself is an open-source tool, so there are no licensing costs associated when running on-premises. Client-covered SaaS licensing, such as with Microsoft Azure, does not involve any costs on our side.

What other advice do I have?

It's important to be very skilled in manual testing concepts before starting with performance testing. Due to JMeter's advanced level of techniques and skill requirements, extensive hands-on experience with real-time projects is needed. It generally takes three to four years of practical experience to master.

I'd rate the solution eight out of ten.

Which deployment model are you using for this solution?

Hybrid Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Rajesh Chouhan - PeerSpot reviewer
Principal Engineer at Marsh McLennan
Real User
Top 5Leaderboard
A highly stable, open-source solution that can be used for load testing
Pros and Cons
  • "We use Apache JMeter for load testing, where we provide the throughput time."
  • "Apache JMeter's UI can be made more colorful."

What is most valuable?

We use Apache JMeter for load testing, where we provide the throughput time. Apache JMeter allows me to give any number of users to put the load in a particular time frame. With Apache JMeter, we won't need multiple tools with the application or to give a load for the application.

What needs improvement?

Apache JMeter's UI can be made more colorful.

For how long have I used the solution?

I have been using Apache JMeter for two years.

What do I think about the stability of the solution?

I rate Apache JMeter ten out of ten for stability.

What do I think about the scalability of the solution?

Around 10 people are using the solution in my team.

I rate Apache JMeter a nine out of ten for scalability.

How was the initial setup?

Apache JMeter's initial setup is easy.

What about the implementation team?

Apache JMeter's deployment takes half an hour to one hour.

What's my experience with pricing, setup cost, and licensing?

Apache JMeter is a free, open-source solution.

What other advice do I have?

I recommend users explore each and every functionality of Apache JMeter.

Overall, I rate Apache JMeter a nine out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
ArtemCheremisin - PeerSpot reviewer
Performance Test Engineer at BETBY
Real User
Top 5Leaderboard
A good load testing tool that comes with a strong online support community, but lacks reporting and analysis functionality
Pros and Cons
  • "We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
  • "We would like some reporting and analysis tools to be added to this solution."

What is our primary use case?

We use this solution to load test functional behavior, and measure performance.

What is most valuable?

We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols.

What needs improvement?

We would like some reporting and analysis tools to be added to this solution.

We would also like the manual available for this solution to allow for better usability; it can be quite complex for new users, and the product is not always very intuitive. 

For how long have I used the solution?

We have been working with this solution for 12 years.

What do I think about the stability of the solution?

We have found this solution to be a stable and reliable tool.

What do I think about the scalability of the solution?

This solution is easily scalable, you can distribute the larger generation among several machines in the LAN, or you can use the cloud variation of the product.

How are customer service and support?

This solution doesn't come with technical support, but there is plug-in wide community support, where organizations can ask questions about issues they are experiencing.

How was the initial setup?

This solution isn't actually deployed, it is a zip file, which is extracted. It can also be deployed via public cloud, if an organization chooses the cloud-based model.

What's my experience with pricing, setup cost, and licensing?

This is an open-source solution, so there are no licensing costs involved.

What other advice do I have?

We would recommend that organizations considering this solution invest time in research of the product before implementing it. There are a lot of online resources that can assist with this, so the business can check if the solution will meet their requirements.

I would rate this solution an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer2123535 - PeerSpot reviewer
Senior Automated Tester & Test Manager & AnalystSenior at a consultancy with 10,001+ employees
Real User
Top 5Leaderboard
Easy to setup, includes a wide range of plugins, but the UI has room for improvement
Pros and Cons
  • "The solution helps by detecting bottlenecks."
  • "The UI has room for improvement."

What is our primary use case?

We use the solution for performance distributing testing.

How has it helped my organization?

The solution helps by detecting bottlenecks.

What is most valuable?

The solution provides a wide range of plugins and extensions, such as multiple monitors and multiple samplers. Apache JMeter can be used for multiple purposes, including performance and API testing, as well as integration testing. Additionally, users can create their own cloud and build their own distributor, eliminating the need to pay for any SaaS solution.

What needs improvement?

The UI has room for improvement.

I would like to be able to measure web performance as well using the solution. Apache JMeter is only for infrastructure testing, and backend testing, but we cannot use it for performance testing because we need to do it through the browser. 

For how long have I used the solution?

I have been using the solution for one year.

What do I think about the stability of the solution?

The solution runs on Java software. 

What do I think about the scalability of the solution?

I give the scalability a five out of ten.

How was the initial setup?

The initial setup is straightforward. The documentation is very detailed.

I created a resource group in our private Azure cloud, and then I had multiple agents. This included one master and four or five slaves of Apache JMeter. I configured the Apache JMeter and began the distribution and testing.

What other advice do I have?

I give the solution a seven out of ten.

I suggest using the solution and following the basics.

Which deployment model are you using for this solution?

Private Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.
Updated: November 2024
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.