Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs BlazeMeter vs OpenText LoadRunner Cloud comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Customer Service

Sentiment score
6.5
Apache JMeter lacks official support but benefits from a strong, helpful community offering prompt assistance and extensive online resources.
No sentiment score available
No sentiment score available
 

Room For Improvement

Sentiment score
5.3
Apache JMeter faces challenges with SSL, scalability, UI, performance, integration, complexity, documentation, user-friendliness, plugins, and scripting.
No sentiment score available
No sentiment score available
With BlazeMeter, you can view the results in real-time.
Currently, we need to use multiple separate JMeter instances to simulate reductions in load, which isn't ideal.
 

Scalability Issues

Sentiment score
6.6
Apache JMeter is scalable and customizable but faces challenges with memory, setup, and performance compared to paid tools.
No sentiment score available
No sentiment score available
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
 

Setup Cost

Sentiment score
7.9
Apache JMeter is a free, open-source tool favored for its cost-effectiveness despite potential additional integration or infrastructure expenses.
No sentiment score available
No sentiment score available
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
Monetary benefits with Apache JMeter are notable as it doesn't require a licensed version, whereas BlazeMeter involves costs.
 

Stability Issues

Sentiment score
6.7
Apache JMeter is stable but may require optimizations for high loads; expert users find it more reliable.
No sentiment score available
No sentiment score available
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
 

Valuable Features

Sentiment score
8.5
Apache JMeter is a popular, affordable, and versatile testing tool appreciated for its usability, extensibility, and comprehensive feature set.
No sentiment score available
No sentiment score available
It's useful for both the person conducting the test and the higher management, like project managers or senior executives, who may not know about the test.
JMeter's open-source nature allows us to create scripts easily, add any number of users during load tests, and handle large volumes of data without additional cost.
 

Mindshare comparison

As of November 2024, in the Performance Testing Tools category, the mindshare of Apache JMeter is 25.0%, up from 22.0% compared to the previous year. The mindshare of BlazeMeter is 16.5%, up from 13.1% compared to the previous year. The mindshare of OpenText LoadRunner Cloud is 8.4%, down from 9.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Performance Testing Tools
 

Featured Reviews

AlexLogan - PeerSpot reviewer
It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve
I rate JMeter five out of 10. You need knowledgeable employees to work with the tool because it's difficult to learn. There is a steep learning curve, so you shouldn't expect an entry-level engineer to pick up the tool quickly and become proficient. It takes a considerable amount of time.
Bala Maddu - PeerSpot reviewer
Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases
Overall, it's helped our ability to address test data challenges. The test data features on their own are very good, but version control test data isn't included yet. I think that's an area for improvement. We can update the test data on the cloud. That's a good feature. There's also test data management, which is good. [Runscope] doesn't have the test data management yet. Mock services do, and performance testing has it. We can do the same test through JMeter, validating the same criteria, but the feedback from [Runscope] is quite visible. We can see the request and the response, what data comes back, and add the validation criteria. We can manage the test environments and test data, but running the same API request for multiple test data is missing. We cloned the test cases multiple times to run it. They need to work on that. Version controlling of the test cases and the information, the ability to compare the current version and the previous version within [Runscope] would be really nice. The history shows who made the changes, but it doesn't compare the changes. In the future, I would like to see integrations with GitLab and external Git reports so we could have some sort of version control outside as well. There is no current mechanism for that. The ability to have direct imports of spoken API specifications instead of converting them to JSON would be nice. There are some features they could work on.
AlexLogan - PeerSpot reviewer
Has realistic scenario composition for performance tests and is highly scalable, but the user interface needs improvement
The solution generates traffic on the infrastructure, which resembles end users. Depending on the performance of the underlying infrastructure and nodes of the architecture, our company team can report on the scalability of applications. The solution performs two types of tests: user interface testing, which is implemented primarily in our organization for online banking, and the other one is API level testing for mobile banking. In terms of the feature set, OpenText LoadRunner Cloud is a market-leading application that has been around for 20 years. I have been working with the solution throughout the acquisition stages; the product used to be much better when it was primarily managed by Mercury. There are limited AI capabilities in the solution; when I was personally operating some smart scenarios using the feature of auto-scaling, I found it unsatisfying. I would recommend the product to others based on its feature set and the level of support. I would rate OpenText LoadRunner Cloud as seven out of ten. There are no glaring weaknesses in the product, and it's good enough for its core purpose.
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
816,562 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
16%
Manufacturing Company
8%
Government
7%
Financial Services Firm
21%
Computer Software Company
17%
Manufacturing Company
8%
Retailer
7%
Financial Services Firm
21%
Computer Software Company
14%
Manufacturing Company
10%
Government
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes p...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and perfo...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
What do you like most about BlazeMeter?
It has a unique programming dashboard that is very user-friendly.
What is your experience regarding pricing and costs for BlazeMeter?
BlazeMeter's pricing is competitive but can be negotiable.
What needs improvement with BlazeMeter?
The scalability features still need improvement. They have recently added dynamic user features, so we should evaluat...
Do you recommend Micro Focus LoadRunner Cloud?
I absolutely recommend Micro Focus LoadRunner Cloud. In fact, I consider it to be one of the best performance testing...
What do you like most about Micro Focus LoadRunner Cloud?
One of LoadRunner's standout features is its extensive support for various TechStacks and protocols.
What is your experience regarding pricing and costs for Micro Focus LoadRunner Cloud?
The pricing is high compared to other licensing tools like NeoLoad. It's not excessively expensive but higher than Ne...
 

Also Known As

JMeter
JMeter Cloud
Micro Focus LoadRunner Cloud, StormRunner Load, LoadRunner Cloud, and Micro Focus StormRunner Load
 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub
Alfa Bank, N Brown Group, University of Copenhagen, McGraw-Hill, Cognizant
Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools. Updated: November 2024.
816,562 professionals have used our research since 2012.