Apache JMeter vs BlazeMeter vs OpenText LoadRunner Cloud comparison

Apache and Perforce are both solutions in the Performance Testing Tools category. Apache is ranked #1 with an average rating of 8.2, while Perforce is ranked #4 with an average rating of 8.0. Apache holds a 24.7% mindshare in PTT, compared to Perforce’s 15.9% mindshare. Additionally, 87% of Apache users are willing to recommend the solution, compared to 93% of Perforce users who would recommend it.

Apache JMeter

Read 92 Apache JMeter reviews

6,532 Views
5,250 Comparison Views

87% willing to recommend

BlazeMeter

Read 47 BlazeMeter reviews

5,493 Views
3,200 Comparison Views

93% willing to recommend

OpenText LoadRunner Cloud

Read 41 OpenText LoadRunner Cloud reviews

3,462 Views
2,039 Comparison Views

92% willing to recommend

Apache JMeter

BlazeMeter

OpenText LoadRunner Cloud

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Apache JMeter, BlazeMeter, and OpenText LoadRunner Cloud based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools.

To learn more, read our detailed Performance Testing Tools Report (Updated: December 2024).

Buyer's Guide

Performance Testing Tools

December 2024

Download the complete report

Helped 824,052 peers since 2012

Mindshare comparison

As of December 2024, in the Performance Testing Tools category, the mindshare of Apache JMeter is 24.7%, up from 22.2% compared to the previous year. The mindshare of BlazeMeter is 15.9%, up from 13.5% compared to the previous year. The mindshare of OpenText LoadRunner Cloud is 8.6%, down from 9.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Performance Testing Tools

Featured Reviews

AlexLogan

Senior Manager, Performance Engineering at Enel Group

It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve

I rate JMeter five out of 10. You need knowledgeable employees to work with the tool because it's difficult to learn. There is a steep learning curve, so you shouldn't expect an entry-level engineer to pick up the tool quickly and become proficient. It takes a considerable amount of time.

Read full review

Bala Maddu

Mobile Network Automation Architect at BT - British Telecom

Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases

Overall, it's helped our ability to address test data challenges. The test data features on their own are very good, but version control test data isn't included yet. I think that's an area for improvement. We can update the test data on the cloud. That's a good feature. There's also test data management, which is good. [Runscope] doesn't have the test data management yet. Mock services do, and performance testing has it. We can do the same test through JMeter, validating the same criteria, but the feedback from [Runscope] is quite visible. We can see the request and the response, what data comes back, and add the validation criteria. We can manage the test environments and test data, but running the same API request for multiple test data is missing. We cloned the test cases multiple times to run it. They need to work on that. Version controlling of the test cases and the information, the ability to compare the current version and the previous version within [Runscope] would be really nice. The history shows who made the changes, but it doesn't compare the changes. In the future, I would like to see integrations with GitLab and external Git reports so we could have some sort of version control outside as well. There is no current mechanism for that. The ability to have direct imports of spoken API specifications instead of converting them to JSON would be nice. There are some features they could work on.

Read full review

AlexLogan

Senior Manager, Performance Engineering at Enel Group

Has realistic scenario composition for performance tests and is highly scalable, but the user interface needs improvement

The solution generates traffic on the infrastructure, which resembles end users. Depending on the performance of the underlying infrastructure and nodes of the architecture, our company team can report on the scalability of applications. The solution performs two types of tests: user interface testing, which is implemented primarily in our organization for online banking, and the other one is API level testing for mobile banking. In terms of the feature set, OpenText LoadRunner Cloud is a market-leading application that has been around for 20 years. I have been working with the solution throughout the acquisition stages; the product used to be much better when it was primarily managed by Mercury. There are limited AI capabilities in the solution; when I was personally operating some smart scenarios using the feature of auto-scaling, I found it unsatisfying. I would recommend the product to others based on its feature set and the level of support. I would rate OpenText LoadRunner Cloud as seven out of ten. There are no glaring weaknesses in the product, and it's good enough for its core purpose.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"JMeter is basically the art of the entire performance testing process."

"JMeter is easy to use for a user who doesn't have too much knowledge of programming or certain languages."

"I like the fact that JMeter integrates well with other tools."

"The most valuable feature of this solution is being able to launch many requests and scheduling simulating human interactions with the application."

"The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences."

"They can easily view the results and gain valuable insights."

"We find the ease of use and the reports and graphs available valuable."

"This solution is easier to use than any other tool in the market; there is not even a requirement to learn a lot of scripting in order to use it."

More Apache JMeter pros

"Its most valuable features are its strong community support, user-friendly interface, and flexible capacity options."

"The most valuable features of the solution stem from the fact that BlazeMeter provides easy access to its users while also ensuring that its reporting functionalities are good."

"The most valuable aspect of BlazeMeter is its user-friendly nature, ability to conduct distributed load testing and comprehensive analysis and reporting features. It particularly excels in providing a clear and organized view of load test results."

"It's a great platform because it's a SaaS solution, but it also builds the on-premises hosting solutions, so we have implemented a hybrid approach. BlazeMeter sets us up for our traditional hosting platforms and application stack as well as the modern cloud-based or SaaS-based application technologies."

"It has helped us simulate heavy load situations so we can fix performance issues ahead of time."

"BlazeMeter's most valuable feature is its cloud-based platform for performance testing."

"It supports any number of features and has a lot of tutorials."

"I really like the recording because when I use the JMeter the scripting a lot of recording it takes me a lot of time to get used to. The BlazeMeter the recording is quick."

More BlazeMeter pros

"The initial setup was straightforward."

"The solution can scale."

"The reports are very relevant to the customers’ expectations."

"The solution is easy to use."

"The TCO has been optimized along with the total ROI."

"The fact that the solution supports multiple protocols such as open source, VuGen, TruWeb, TruClient, and SAP is very important because these protocols help us to concentrate on what is really needed to produce performance tests. If something is not supported, you have to use other tools or find other ways of assimilating loads."

"The most valuable feature is having load generators in countries where we don’t have access to them."

"The most valuable feature is that you can create an infrastructure on-demand and do performance testing with it."

More OpenText LoadRunner Cloud pros

Cons

"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."

"In this tool, automation in general is almost non-existent. Everything is done manually."

"Improving JMeter's sync time would be beneficial."

"We would like more documentation to be provided for the advanced level features that are available in this solution, in order to improve development."

"JMeter's reporting is extremely rudimentary. The fundamental reporting mechanisms need to be drastically improved. It doesn't utilize an automatic session management mechanism or methods other tools use like parsing cookies and variables. Everything needs to be done manually. There's no automation."

"It requires integration with other tools for live metrics, which is time-consuming."

"We're like the solution to be more user-friendly."

"One area for improvement is the ability to decrease load suddenly during tests. Currently, we need to use multiple separate JMeter instances to simulate reductions in load, which isn't ideal."

More Apache JMeter cons

"Lacks an option to include additional users during a test run."

"The should be some visibility into load testing. I'd like to capture items via snapshots."

"In terms of improvement, I would like to have the ability to customize reports."

"Integration with APM tools like Dynatrace or AppDynamics needs to be improved."

"Sometimes, when we execute tests, the results calculated by BlazeMeter, specifically the response times for failed transactions, are incorrect."

"The only downside of BlazeMeter is that it is a bit expensive."

"The support could be better."

"If the solution had better support and the documentation was efficient it would do better in the market."

More BlazeMeter cons

"One area of improvement in the software's support is the replaying of captured data within the development environment. It would be beneficial if the replay feature could accurately mimic what the actual application is doing for better analysis and testing."

"Their documentation is not technical enough for us. We would like to have much deeper technical documentation so that we can self-serve without constantly having to go back to them and ask."

"It should have a feature to report with a 99.9 percentile success rate."

"It doesn't provide custom reports. You can only use the default reports which contain irrelevant data or is missing data that we need."

"Some improvements can be made to the solution's user interface"

"One area for improvement in LoadRunner Cloud, especially for agile models, is its limited support for functional testing alongside its robust non-functional testing capabilities."

"An area for improvement is analytics on why response times are slow from certain countries."

"The product price could be more affordable."

More OpenText LoadRunner Cloud cons

Pricing and Cost Advice

"Free"

"This is an open-source solution, so there are no licensing costs associated with it."

"We didn't pay licensing fees for Apache JMeter because it's an open-source tool. We only paid for the machines where we installed Apache JMeter modules."

"JMeter is open source and available free of charge."

"I was using the free version of the software."

"We are using the free version, and if required, we can easily switch to the other version."

"This is an open-source solution, and there are no fees."

"When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"

More Apache JMeter pricing and cost advice

"My company has opted for a pay-as-you-go model, so we don't make use of the free version of the product."

"The product pricing is reasonable."

"The overall product is less costly than our past solutions, so we've absolutely saved money."

"The solution is free and open source."

"I would rate the pricing a three out of ten, where one is very cheap, and ten is very expensive."

"We pay a yearly licensing fee for the solution."

"The product isn't cheap, but it isn't the most expensive on the market. During our proof of concept, we discovered that you get what you pay for; we found a cheaper solution we tested to be full of bugs. Therefore, we are willing to pay the higher price tag for the quality BlazeMeter offers."

"The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."

More BlazeMeter pricing and cost advice

"It's a very expensive solution"

"The pricing is very reasonable and the licensing is straightforward."

"The solution is expensive."

"It is neither costly nor cheap. It is not too high and not too low. I know the price of other tools, and LoadRunner Cloud's price is in the medium range."

"The pricing for OpenText LoadRunner Cloud is average."

"There is no monthly or yearly cost but rather, the fees are based on the amount of traffic that you use."

"The solution’s price is considerably high."

"It is expensive compared to other tools."

More OpenText LoadRunner Cloud pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.

See recommendations

824,052 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

19%

Computer Software Company

16%

Manufacturing Company

Government

Financial Services Firm

21%

Computer Software Company

17%

Manufacturing Company

Retailer

Financial Services Firm

20%

Computer Software Company

15%

Manufacturing Company

Government

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

How does Postman compare with Apache JMeter?

Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes p...

See all answers

How does BlazeMeter compare with Apache JMeter?

Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and perfo...

See all answers

What do you like most about Apache JMeter?

I appreciate JMeter's simplicity and power for performance testing.

See all answers

What do you like most about BlazeMeter?

It has a unique programming dashboard that is very user-friendly.

See all answers

What is your experience regarding pricing and costs for BlazeMeter?

BlazeMeter's pricing is competitive but can be negotiable.

See all answers

What needs improvement with BlazeMeter?

The scalability features still need improvement. They have recently added dynamic user features, so we should evaluat...

See all answers

Do you recommend Micro Focus LoadRunner Cloud?

I absolutely recommend Micro Focus LoadRunner Cloud. In fact, I consider it to be one of the best performance testing...

See all answers

What do you like most about Micro Focus LoadRunner Cloud?

One of LoadRunner's standout features is its extensive support for various TechStacks and protocols.

See all answers

What is your experience regarding pricing and costs for Micro Focus LoadRunner Cloud?

The pricing is high compared to other licensing tools like NeoLoad. It's not excessively expensive but higher than Ne...

See all answers

Comparisons

Tricentis NeoLoad vs Apache JMeter

Compared 17% of the time

Postman vs Apache JMeter

Compared 13% of the time

Katalon Studio vs Apache JMeter

Compared 6% of the time

ReadyAPI vs Apache JMeter

Compared 5% of the time

Tricentis Tosca vs Apache JMeter

Compared 1% of the time

More Apache JMeter Competitors

Tricentis NeoLoad vs BlazeMeter

Compared 9% of the time

OpenText LoadRunner Professional vs BlazeMeter

Compared 3% of the time

BrowserStack vs BlazeMeter

Compared 2% of the time

Tricentis Flood vs BlazeMeter

Compared 2% of the time

k6 Open Source vs BlazeMeter

Compared 2% of the time

More BlazeMeter Competitors

OpenText LoadRunner Enterprise vs OpenText LoadRunner Cloud

Compared 28% of the time

Tricentis NeoLoad vs OpenText LoadRunner Cloud

Compared 22% of the time

OpenText LoadRunner Professional vs OpenText LoadRunner Cloud

Compared 20% of the time

RadView WebLOAD vs OpenText LoadRunner Cloud

Compared 2% of the time

Tricentis Tosca vs OpenText LoadRunner Cloud

Compared 2% of the time

More OpenText LoadRunner Cloud Competitors

Product Reports

Buyer's Guide

Apache JMeter

December 2024

Download Apache JMeter product report

Buyer's Guide

BlazeMeter

December 2024

Download BlazeMeter product report

Buyer's Guide

OpenText LoadRunner Cloud

December 2024

Download OpenText LoadRunner Cloud product report

Also Known As

JMeter

JMeter Cloud

Micro Focus LoadRunner Cloud, StormRunner Load, LoadRunner Cloud, and Micro Focus StormRunner Load

Learn More

Apache

Perforce

OpenText

Overview

Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

What protocols does JMeter support?

Web - HTTP, HTTPS
Web services - SOAP/XML-RPC
Email service - POP3, IMAP, SMTP
FTP service
Database via JDBC drivers
LDAP
Native commands or shell scripts
TCP
Java objects

How does JMeter work?

JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

Apache JMeter Key Features

JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
Command-line mode allows carrying out load tests from any OS compatible with Java.
JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
JMeter is entirely portable.
A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
Thanks to the caching feature, you can conduct offline analysis or replay test results.

Apache JMeter Benefits

As open-source software, it is freely available and continuously improved.
The setup is user-friendly, and no installation is needed.
The GUI (graphic user interface) is intuitive and easy to use.
You can write your own tests and use the visualization plugins to extend the testing.
It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
Since the test plans are stored in XML format, you can generate a test plan using any text editor.
You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

The JMeter extensible core has numerous benefits:

Unlimited testing capabilities via pluggable samplers.
You can choose multiple load statistics with pluggable timers.
Visualization plugins and data analysis enable customization.
Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

Reviews from Real Users

Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

"I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.

The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.

Do your performance and load testing in the cloud. OpenText LoadRunner Cloud makes it easy to plan, run, and scale performance tests without the need to deploy and manage infrastructure.

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape

DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub

Alfa Bank, N Brown Group, University of Copenhagen, McGraw-Hill, Cognizant

Buyer's Guide

Performance Testing Tools

December 2024

Download Free Report

Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools. Updated: December 2024.

DOWNLOAD NOW

824,052 professionals have used our research since 2012.