Try our new research platform with insights from 80,000+ expert users
Associate at Tech Mahindra Limited
Real User
Easy to learn, and free to use but could be more user-friendly
Pros and Cons
  • "We appreciate that the solution is free to use, as an open-source tool."
  • "We're like the solution to be more user-friendly."

What is our primary use case?

We primarily use the solution for testing. We have three types of testing. One is the APA testing, and the web, and one is mobile. All have been recorded through this protocol.

What is most valuable?

We appreciate that the solution is free to use, as an open-source tool.

We're using all of the lightweight technology with the AngularJS and Springboard applications, all the EPAs only. We use these CTP samples for all the web, as well as the EPAs. 

The initial setup is pretty straightforward.

The product is easier to learn than paid tools. You can find training online on YouTube, or you can Google it to find out more about the solution and how to use it.

The JMeter community has developed a lot of IoT protocols. 

What needs improvement?

We're like the solution to be more user-friendly. 

As freeware, not everything is readily available. You can't play around with everything. That's just due to the fact that it's not a paid tool. When you pay for tools, you get a bit more. 

Not everything is supported by JMeter. It's limited.

With JMeter, with banking encryption, we have struggled a lot. It's not as good as other paid tools that provide support and configuration capabilities that JMeter lacks. 

The solution doesn't really have good documentation, and, if you run into issues you can't simply raise a ticket. There's no help available to you.

There are certain protocols that you can get on other solutions, such as LoadRunner, that you can't get on JMeter.

What do I think about the stability of the solution?

The stability is pretty good. You can execute any kind of tech with JMeter as well. It's an open-source community. There are a number of samples are available. You can achieve it in different ways, however, the stability is quite good. That said, we have experienced glitches. 

Buyer's Guide
Apache JMeter
January 2025
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
831,265 professionals have used our research since 2012.

What do I think about the scalability of the solution?

Scalability is possible. You need to have the load generator for the scaling of your application. It's very simple to procure the load generator. You will have to install the JMeter agent file, where it'll be connecting to the monitor. It will not be as simple as a paid tool. For example, with BlazeMeter, they provide scaling with the cloud. BlazeMeter supports the JMeter items. If you have thousands of users, you will need the cloud and you'll need something like BlazeMeter. 

Currently, as this is a banking application, we don't have that many users. However, I've tried it with the 5000 users with the five to six load generators in the cloud. If we want to really scale, however, it's best to go with BlazeMeter.

How are customer service and support?

As an open-source tool, support is not available for JMeter.

Which solution did I use previously and why did I switch?

We also use NeoLoad. JMeter is open-source. It suggests you need to install that and you can make the cloud as a distributor system. NeoLoad is paid. We have some licenses and discounts. We cannot use NeoLoad due to the licenses. That's why we moved the solution to JMeter which is free and open-source.

How was the initial setup?

The initial implementation is very simple. Initially, when setting up JMeter, you have to follow the proper documentation. It's very simple, however, if you do make some mistakes, you'll not be able to set up the distributed system. You need to have a little bit of networking knowledge so that all the systems should be in the same network and subnet. Connectivity should be established. It can be very difficult to execute. If you try to do everything all at once. I had some experience and I did it in the parts. It's very simple for me.

What about the implementation team?

I handled the implementation myself. 

What's my experience with pricing, setup cost, and licensing?

The solution is open-source and free to use.

So long as you don't have to scale too much, it's very cost-effective. If you do have to scale your users, it's best to move over to BlazeMeter, which is reasonably priced, user-friendly, and works well.

What other advice do I have?

I would not recommend this solution for machine-critical applications such as banking or telecom applications. For those, we would go for paid tools. That way, if there are any technical issues or technical breaches with the tool, with the application we are supporting, we can call on support for troubleshooting. With JMeter, we don't have this option. It is good, however, for non-critical applications. In telecom or banking applications, they need to have critical releases and patches, and issues have a high likelihood of leading to a loss of business. We don't want to take chances. However, for non-critical items, JMeter is fine.

I'd recommend the solution to other users so long as they keep in mind JMeter's capabilities are limited. The upside is it is free to use, however, there's also a limit, to some extent, on how you can use it. IF you have a small-scale organization and a small number of users, JMeter will work well.

I'd rate the solution at a seven out of ten.

Which deployment model are you using for this solution?

Private Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Software Solution Architect at Beltone Financial
Real User
Helps in the capacity assessment planning for services
Pros and Cons
  • "The product helps me get the expected performance from applications or servers and reduces costs. It also enhances the performance of the services and helped them reach their ultimate capacity."
  • "The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways."

What is our primary use case?

The tool helps us in the capacity assessment planning for our services. It helps us to make sure that the APIs will be able to afford the traffic that we expect to get from these services in the production environment. 

How has it helped my organization?

The product helps me get the expected performance from applications or servers and reduces costs. It also enhances the performance of the services and helped them reach their ultimate capacity. 

What needs improvement?

The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways. 

For how long have I used the solution?

I have been using the solution for more than three to four years. 

What do I think about the stability of the solution?

The tool is stable. 

What do I think about the scalability of the solution?

The product is scalable. My company has around four to five users for the solution. 

How was the initial setup?

The product's setup is not complex. The tool's installation was very smooth.  It doesn't have any deployment process. You just need to implement a set of packages to get started with the product. 

What other advice do I have?

I would rate the product an eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Apache JMeter
January 2025
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
831,265 professionals have used our research since 2012.
Anto Infanta - PeerSpot reviewer
Senior Test Engineer at a computer software company with 201-500 employees
MSP
An open-source solution that offers good test script development functionality, but does not have a script exhibition feature
Pros and Cons
  • "This solution is very user-friendly, and allows for a lot of data capture when testing."
  • "We would like more documentation to be provided for the advanced level features that are available in this solution, in order to improve development."

What is our primary use case?

We mainly use this product for load and endurance testing.

What is most valuable?

This solution is very user-friendly, and allows for a lot of data capture when testing.  

We also found that the test scripts that the system automatically generates are extremely well created.

What needs improvement?

We would like more documentation to be provided for the advanced level features that are available in this solution, in order to improve development.

For how long have I used the solution?

We have been using this solution for two to three years.

What do I think about the stability of the solution?

We have found this solution to be very stable overall.

What do I think about the scalability of the solution?

We believe this to be a scalable solution, although we have not made any amendments in user numbers to date.

How was the initial setup?

The initial setup of this solution was very simple; the product is open-source, so only requires a download in order for the implementation to be executed.

What about the implementation team?

We implemented this solution using our in-house team.

What's my experience with pricing, setup cost, and licensing?

This is an open-source solution, so there is no requirement for licenses.

What other advice do I have?

We would recommend that any organization using this solution for test script development, may also want to look for a complementary product to handle script exhibition.

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
DevOps Engineer at a computer software company with 501-1,000 employees
Real User
Simple setup, reliable, and good online community available
Pros and Cons
  • "Apache JMeter is stable."
  • "In Micro Focus LoadRunner we can go from the UI and we can configure it. There is no such feature in Apache JMeter. There should be UI-based recording history or logs."

What needs improvement?

In Micro Focus LoadRunner we can go from the UI and we can configure it. There is no such feature in Apache JMeter. There should be UI-based recording history or logs.

For how long have I used the solution?

I have been using Apache JMeter for one year.

What do I think about the stability of the solution?

Apache JMeter is stable.

What do I think about the scalability of the solution?

I have found Apache JMeter to be scalable.

How are customer service and support?

Since Apache JMeter is open source there is no vendor support, you have to use the online communities available.

Which solution did I use previously and why did I switch?

I have used Micro Focus LoadRunner previously and it is better features than Apache JMeter. However, it is not free.

How was the initial setup?

The initial setup was easy for Apache JMeter.

What's my experience with pricing, setup cost, and licensing?

Apache JMeter is a free open source solution and it is why we are using it.

What other advice do I have?

For those who do not want to spend money on tools then this solution would be a good choice. This is the best solution in the open-source category.

I rate Apache JMeter an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Software Architect at a computer software company with 10,001+ employees
Real User
Script-generation is helpful for people with little programming knowledge
Pros and Cons
  • "JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages."
  • "Considering the kinds of tests we are performing here, where we launch several tests at the same time as a batch request, JMeter is not the best tool for the job. Those kinds of things could be done easily with other tools, like T6."

What is our primary use case?

Our primary use for it is testing websites: load testing and performance testing.

What is most valuable?

JMeter is very easy for a user who doesn't have too much programming knowledge, as scripting is not mandatory nor essential to create the testing scenarios. This means the user doesn't need to know how to write code to run a complete set of load tests. Although, If you're an advanced user, JMeter does gives the possibility of using BeanShell, Groovy or Java to script your tests.

JMeter has a very friendly and intuitive User Interface which allows users to configure the scenarios reusing components already defined, which you can also modify to fit the requirements of the tests.

One very important feature of JMeter is that it is open source and it can be easily extended through a huge set of available plugins.

What needs improvement?

Considering the kinds of tests we are performing here, where we launch several tests at the same time as a batch request, JMeter is not the best tool for the job. Those kinds of things could be done easily with other tools, like k6. It would be simpler that way. JMeter is a very old tool. It has been around for about 15 years. While it has been improved over the last few years, it is a little complicated to run several tests at the same time with different sites.

JMeter could be easier. It would be a great improvement if it was easier to integrate with the CI deployments, with tools like Jenkins or CircleCI.

For how long have I used the solution?

Our teams have been using it for about five years.

What do I think about the stability of the solution?

It is a very stable tool.

What do I think about the scalability of the solution?

In my opinion, it is not scalable. We haven't found an easy way to do that.

We would like to increase our usage but we are trying to figure out the best way to integrate it with our new circuit. Our plan is to use a tool like this with customers. That is the reason we are evaluating the pros and cons of different tools. We want to incorporate these tools into our web development process, mainly in our CI/CD process. We are trying to figure out how to use tools that are designed to empower developers.

Which solution did I use previously and why did I switch?

We have used LoadUI and SmartBear with tools like Selenium. Some of the developers, at that time, were used to JMeter and they introduced it. It is a very nice tool.

How was the initial setup?

The initial setup is simple. It is not a hard tool to use. It has a very nice UI and the end-users are very comfortable using the tool. People deploy it themselves.

What other advice do I have?

I would definitely recommend JMeter. It is a very nice tool. It is easy to use and there are several components already developed in the tool that you can use to simplify the process of defining and redefining scripts. But I would like it to be more flexible and integrate with other tools.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Fatih Mehmet HARMANCI - PeerSpot reviewer
Software Testing Services Manager at Virgosol
Real User
Top 20
Free and not difficult to set up, but it is difficult to test APIs and model a test
Pros and Cons
  • "We are using it just for load testing. We are using its free version, and it is scalable."
  • "Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."

What is our primary use case?

We are using it for load testing. We test other companies' programs.

What is most valuable?

We are using it just for load testing. We are using its free version, and it is scalable.

What needs improvement?

I am not satisfied with this solution. Its UI side is not so easy to use for beginners. It should be easier. 

Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult.

For JSON, you can use tools such as JSONBuddy, but they are difficult to get in JMeter. It should be easy to get JSONBuddy from the website. I have to use BlazeMeter only to get JSONBuddy.

For how long have I used the solution?

It has been about five months.

What do I think about the stability of the solution?

It is not so stable.

What do I think about the scalability of the solution?

It is scalable.

How are customer service and support?

Their support is fine. There are not many Apache documents, but you can find other documents on the web.

How was the initial setup?

It is not so difficult.

What's my experience with pricing, setup cost, and licensing?

We are using the free version.

What other advice do I have?

I would rate it a seven out of 10.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1191885 - PeerSpot reviewer
Director with 201-500 employees
Real User
Fast, user-friendly open-source testing tool
Pros and Cons
  • "It is very quick and user-friendly."
  • "If the solution was GUI based, I believe that it would be more versatile."

What is our primary use case?

I implement this solution for my clients.

What is most valuable?

It is very quick and user-friendly.

What needs improvement?

If the solution was GUI based, I believe that it would be more versatile.

For how long have I used the solution?

I have been using this solution anywhere from six to eight years.

What do I think about the stability of the solution?

The solution is stable, I would definitely recommend it to those who are considering it.

What do I think about the scalability of the solution?

The solution is scalable.

What's my experience with pricing, setup cost, and licensing?

No licensing is required as it is a free, open-source tool.

Which deployment model are you using for this solution?

Hybrid Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Amazon Web Services (AWS)
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user324075 - PeerSpot reviewer
Founder & CEO at a tech services company with 51-200 employees
Real User
JMeter supports HTTP/HTTPS, DBs, FTP, and other system protocols and easy to crate basic scripts but has limitations on the reports

What is most valuable?

  • Recording/Playback
  • Templates for test plans (NEW)
  • Integrate with Java and many other scripting languages
  • Integrating with external plug-ins

How has it helped my organization?

  • The recording feature makes it easy to create test plans
  • They have templates that make starting very easy (this feature is added recently)
  • Supports a lot of protocols (HTTP, HTTPS, FTP , SMTP etc)
  • Simplicity of use
  • As compared to commercial tools, it provides better reporting features through third-party plug-ins
  • There's also a huge community around tool, and because of that when there's an issue, you can get solutions easily, and without cost For example, we dis a very complex testing of HL7 protocols, which JMeter doesn't support directly, but it's extendable to support the protocols
  • Supports Java and other scripting languages and can extend capabilities.

What needs improvement?

Reporting could be better if it could be like commercial tools. For example, a nice chart and visualizations. You can’t rely on the first 100 test results because the ramp-up and ramp-down time gives false results with outliers. It would be great if an option to ignore first 100 and last 100 records from results and then generate reports, should be great. Needs to support more concurrent users by single JMeter instance (agent/slave)

For how long have I used the solution?

I've been using it for over last five years, and it is a major, active open source tool.

What was my experience with deployment of the solution?

No issues with recent releases

What do I think about the stability of the solution?

There are issues when tests are stopped with large number of concurrent users. Test is not stopped as expected.

How are customer service and technical support?

Customer Service:

There is a huge community around JMeter. Hence free support is available to the users.

Technical Support:

Excellent (from the community)

Which solution did I use previously and why did I switch?

Grinder. Grinder was not user friendly and had to do lot of coding and low level configurations. It was lighter than JMeter.

How was the initial setup?

Initial setup is straight forward. You need to have have JDK or JRE for running JMeter.

What about the implementation team?

We have a team of testers capable of managing the JMeter perfromance testing project effectively.

What other advice do I have?

It's easy to use and free, a huge community, and it offers a risk free to start, so use it for application performance testing. It supports connectivies with databases, FTP, and other system protocols.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user4032 - PeerSpot reviewer
it_user4032CTO with 11-50 employees
Vendor

Hello Janesh,
Thanks for this nice review.
Just one note, since JMeter 3.0 and even more in 3.1, JMeter has now :

- a new Web Reporting feature, see jmeter.apache.org

- Scalable Real-time Graphs in NON GUI mode thanks to 3rd party open sources like Graphite or InfluxDB, see jmeter.apache.org

Regards
Philippe M. from Apache JMeter Team

Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.
Updated: January 2025
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.