Apache JMeter vs BlazeMeter vs OpenText LoadRunner Cloud comparison

Apache and Perforce are both solutions in the Performance Testing Tools category. Apache is ranked #1 with an average rating of 8.1, while Perforce is ranked #4 with an average rating of 8.1. Apache holds a 25.0% mindshare in PTT, compared to Perforce’s 16.4% mindshare. Additionally, 86% of Apache users are willing to recommend the solution, compared to 93% of Perforce users who would recommend it.

Apache JMeter

Read 86 Apache JMeter reviews

6,944 Views
5,638 Comparison Views

86% willing to recommend

BlazeMeter

Read 47 BlazeMeter reviews

5,949 Views
3,412 Comparison Views

93% willing to recommend

OpenText LoadRunner Cloud

Read 41 OpenText LoadRunner Cloud reviews

3,865 Views
2,280 Comparison Views

92% willing to recommend

Apache JMeter

BlazeMeter

OpenText LoadRunner Cloud

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Apache JMeter, BlazeMeter, and OpenText LoadRunner Cloud based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools.

To learn more, read our detailed Performance Testing Tools Report (Updated: September 2024).

Buyer's Guide

Performance Testing Tools

September 2024

Download the complete report

Helped 813,266 peers since 2012

Mindshare comparison

As of October 2024, in the Performance Testing Tools category, the mindshare of Apache JMeter is 25.0%, up from 21.4% compared to the previous year. The mindshare of BlazeMeter is 16.4%, up from 12.4% compared to the previous year. The mindshare of OpenText LoadRunner Cloud is 8.5%, down from 10.1% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Performance Testing Tools

Featured Reviews

AlexLogan

Senior Manager, Performance Engineering at Enel Group

Aug 9, 2022

It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve

JMeter is used by a team of four performance engineers. We monitor tasks on the API level, so all of the requests are hitting individually JMeter has helped us streamline our applications by identifying multiple bottlenecks in our systems and exercising tasks against APIs. JMeter is a free tool…

Read full review

Bala Maddu

Mobile Network Automation Architect at BT - British Telecom

Jul 17, 2022

Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases

Overall, it's helped our ability to address test data challenges. The test data features on their own are very good, but version control test data isn't included yet. I think that's an area for improvement. We can update the test data on the cloud. That's a good feature. There's also test data management, which is good. [Runscope] doesn't have the test data management yet. Mock services do, and performance testing has it. We can do the same test through JMeter, validating the same criteria, but the feedback from [Runscope] is quite visible. We can see the request and the response, what data comes back, and add the validation criteria. We can manage the test environments and test data, but running the same API request for multiple test data is missing. We cloned the test cases multiple times to run it. They need to work on that. Version controlling of the test cases and the information, the ability to compare the current version and the previous version within [Runscope] would be really nice. The history shows who made the changes, but it doesn't compare the changes. In the future, I would like to see integrations with GitLab and external Git reports so we could have some sort of version control outside as well. There is no current mechanism for that. The ability to have direct imports of spoken API specifications instead of converting them to JSON would be nice. There are some features they could work on.

Read full review

AlexLogan

Senior Manager, Performance Engineering at Enel Group

Jun 3, 2024

Has realistic scenario composition for performance tests and is highly scalable, but the user interface needs improvement

The solution generates traffic on the infrastructure, which resembles end users. Depending on the performance of the underlying infrastructure and nodes of the architecture, our company team can report on the scalability of applications. The solution performs two types of tests: user interface testing, which is implemented primarily in our organization for online banking, and the other one is API level testing for mobile banking. In terms of the feature set, OpenText LoadRunner Cloud is a market-leading application that has been around for 20 years. I have been working with the solution throughout the acquisition stages; the product used to be much better when it was primarily managed by Mercury. There are limited AI capabilities in the solution; when I was personally operating some smart scenarios using the feature of auto-scaling, I found it unsatisfying. I would recommend the product to others based on its feature set and the level of support. I would rate OpenText LoadRunner Cloud as seven out of ten. There are no glaring weaknesses in the product, and it's good enough for its core purpose.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"We use Apache JMeter for load testing, where we provide the throughput time."

"I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance."

"It's stable and reliable."

"The reports and analysis tools are very good. They are the solution's most valuable features."

"It's very easy to install, and it's very easy to code and develop the script."

"To me, what's most valuable in Apache JMeter is that it's a lightweight tool for application testing. It's the best load-testing tool for my company because Apache JMeter simulates your application during testing. Apache JMeter also creates threads with good server utilization. Apache JMeter allows you to focus on analyzing the situation, looking into measurements, response time, and client-server responses, which I find valuable."

"When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution."

"Apache JMeter is well-known and widely used among developers, particularly on popular developer forums. While it may not have the most user-friendly interface, it offers strong support through official manuals and various articles from companies providing load testing services. The tool is free, has a substantial community, and serves as a fundamental choice for testers, especially those new to performance testing. While other tools like K6 may be more developer-oriented, JMeter's affordability and accessibility make it suitable for those without extensive performance testing experience."

More Apache JMeter pros

"It has a unique programming dashboard that is very user-friendly."

"Running from the cloud with load distribution, exhibiting load from different geo-regions. Generating the load from different cloud regions is the best feature."

"BlazeMeter has allowed us to simplify and speed up our load testing process."

"Using cloud-based load generators is highly valuable to us, as we can test from outside our network and increase load generation without having to upscale our hardware as much. The cloud load generator is there when we need it and is the feature we leverage the most."

"One thing that we are doing a lot with the solution, and it's very good, is orchestrating a lot of JMeter agents. This feature has helped us a lot because we can reuse other vendors' performance scripts that they have used with JMeter before."

"It is focused on concurrency testing, which has been especially beneficial for us. Their previous experiences had caused major setbacks."

"The product's most valuable features include its cloud-based nature, which allows us to conduct tests without relying on local resources."

"The solution’s most valuable feature is the dashboard."

More BlazeMeter pros

"The record and playback feature is the most valuable feature. It's all driven by the script, so it's a script-based tool where the background tracing starts. Java's background process does a lot of tracing. The process starts in the background. It sees what peaks of volumes that the process can handle. It's easy to use because it's script based, record, and playback. I"

"The fact that the solution supports multiple protocols such as open source, VuGen, TruWeb, TruClient, and SAP is very important because these protocols help us to concentrate on what is really needed to produce performance tests. If something is not supported, you have to use other tools or find other ways of assimilating loads."

"The most valuable feature is that we do not have to accommodate the load-testing infrastructure in our own data center."

"The solution is easy to use."

"It is feature-rich. It supports most protocols, which is important because I am in charge of a team at the bank, and we do performance testing for all kinds of different applications. We have tons of them. We even do video streams."

"The most valuable feature is having load generators in countries where we don’t have access to them."

"The initial setup was straightforward."

"The product supports a wide variety of technology compared to any other tool."

More OpenText LoadRunner Cloud pros

Cons

"The only thing is the learning curve. It's high."

"Automation is difficult in JMeter."

"The tool should be made a bit more robust, and better support should be made available."

"I need to consider it further because as features increase, it might become more complicated, and my goal has always been simplicity. Currently, I have to focus on other tasks, and I'm handling multiple responsibilities, so I can't juggle everything at once. However, if you ask me, I believe EJB covers most functionalities that are crucial. One improvement I'd suggest is adding a graphical aspect to the Gateway, making it a bit more colorful. Unlike JMeter, which lacks color, having a bit of color in the graphical aspects would be beneficial. Overall, for the essential features, EJB should work fine."

"Both scalability and stability could be improved in Apache JMeter."

"The user interface is a little bit tricky."

"The stability could be a bit better."

"The tool needs to have a better Graphical User Interface. Many of the solution's features are difficult to understand due to the complex user interface and user experience. The product needs to add plugins. It should also work on the integration with external partners like IDE and API gateways."

More Apache JMeter cons

"Potential areas for improvement could include pricing, configuration, setup, and addressing certain limitations."

"The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff."

"Version controlling of the test cases and the information, the ability to compare the current version and the previous version within Runscope would be really nice. The history shows who made the changes, but it doesn't compare the changes."

"I believe that data management and test server virtualization are things that Perforce is working on, or should be working on."

"Integration is one of the things lacking in BlazeMeter compared to some newer options."

"We encountered some minor bugs, and I would like to have the ability to add load generators to workspaces without having to use APIs. We can't do that now, so we're beholden to the APIs."

"Scalability is an area of concern in BlazeMeter, where improvements are required."

"The tool fails to offer better parameterization to allow it to run the same script across different environments, making it a feature that needs a little improvement."

More BlazeMeter cons

"The product price could be more affordable."

"I don't know of any features that should be added. The solution isn't lacking anything at this point."

"We are trying to put it into a complete CI/CD pipeline, but there are still some challenges when you try to run it through different protocols. The challenges are around how you can containerize applications. There are some limitations to some protocols, such as desktop. And when it comes to database testing, there are some things that we can't do through CI/CD."

"There is a steep learning curve for the product, too."

"Improvements to the reporting would be good."

"One area of improvement in the software's support is the replaying of captured data within the development environment. It would be beneficial if the replay feature could accurately mimic what the actual application is doing for better analysis and testing."

"It should have a feature to report with a 99.9 percentile success rate."

"An area for improvement is analytics on why response times are slow from certain countries."

More OpenText LoadRunner Cloud cons

Pricing and Cost Advice

"Apache JMeter is a free tool."

"We didn't pay licensing fees for Apache JMeter because it's an open-source tool. We only paid for the machines where we installed Apache JMeter modules."

"The tool is open-source."

"I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."

"Everything is included, and there are no additional costs."

"It is open source. There are no licensing costs associated. If you need enterprise support, you'll probably end up paying for a license. You would also factor in the infrastructure cost, but that's not significant."

"This is an open-source solution, so there are no licensing costs involved."

"Since we are using an outsourced solution, it is not paid for by our company."

More Apache JMeter pricing and cost advice

"The solution is free and open source."

"I would rate the pricing a three out of ten, where one is very cheap, and ten is very expensive."

"I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."

"We pay a yearly licensing fee for the solution."

"The pricing is manageable. It is not that big. Big companies won't mind the licensing costs."

"The product isn't cheap, but it isn't the most expensive on the market. During our proof of concept, we discovered that you get what you pay for; we found a cheaper solution we tested to be full of bugs. Therefore, we are willing to pay the higher price tag for the quality BlazeMeter offers."

"When compared with the cost of the licenses of other tools, BlazeMeter's license price is good."

"The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."

More BlazeMeter pricing and cost advice

"It is expensive compared to other tools."

"It is neither costly nor cheap. It is not too high and not too low. I know the price of other tools, and LoadRunner Cloud's price is in the medium range."

"The solution is expensive."

"The solution’s price is considerably high."

"The pricing is very reasonable and the licensing is straightforward."

"We make use of virtual user hours. We buy time in the LoadRunner Cloud. It costs around $80,000."

"Pricing is dependent on what you're referring to. If you're talking about the cloud, it's likely competitive. However, if you're talking about the on-premise version, professional or enterprise licenses are required. Prices are on the high side. They are not cheap."

"There is no monthly or yearly cost but rather, the fees are based on the amount of traffic that you use."

More OpenText LoadRunner Cloud pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.

See recommendations

813,266 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

19%

Computer Software Company

17%

Manufacturing Company

Government

Financial Services Firm

21%

Computer Software Company

19%

Retailer

Manufacturing Company

Financial Services Firm

21%

Computer Software Company

14%

Manufacturing Company

10%

Government

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

How does Postman compare with Apache JMeter?

Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes p...

See all answers

How does BlazeMeter compare with Apache JMeter?

Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and perfo...

See all answers

What do you like most about Apache JMeter?

I appreciate JMeter's simplicity and power for performance testing.

See all answers

What do you like most about BlazeMeter?

It has a unique programming dashboard that is very user-friendly.

See all answers

What is your experience regarding pricing and costs for BlazeMeter?

It is a bit pricey, especially if you're primarily interested in its recording and script conversion features. Howeve...

See all answers

What needs improvement with BlazeMeter?

The pricing is high because the advanced version comes with different features. Unlike JMeter, which offers a free ve...

See all answers

Do you recommend Micro Focus LoadRunner Cloud?

I absolutely recommend Micro Focus LoadRunner Cloud. In fact, I consider it to be one of the best performance testing...

See all answers

What do you like most about Micro Focus LoadRunner Cloud?

One of LoadRunner's standout features is its extensive support for various TechStacks and protocols.

See all answers

What is your experience regarding pricing and costs for Micro Focus LoadRunner Cloud?

The pricing is high compared to other licensing tools like NeoLoad. It's not excessively expensive but higher than Ne...

See all answers

Comparisons

Postman vs Apache JMeter

Compared 16% of the time

Tricentis NeoLoad vs Apache JMeter

Compared 15% of the time

Katalon Studio vs Apache JMeter

Compared 6% of the time

ReadyAPI vs Apache JMeter

Compared 4% of the time

Tricentis Tosca vs Apache JMeter

Compared 1% of the time

More Apache JMeter Competitors

Tricentis NeoLoad vs BlazeMeter

Compared 8% of the time

OpenText LoadRunner Professional vs BlazeMeter

Compared 3% of the time

Tricentis Flood vs BlazeMeter

Compared 2% of the time

BrowserStack vs BlazeMeter

Compared 2% of the time

Perfecto vs BlazeMeter

Compared 2% of the time

More BlazeMeter Competitors

OpenText LoadRunner Enterprise vs OpenText LoadRunner Cloud

Compared 29% of the time

Tricentis NeoLoad vs OpenText LoadRunner Cloud

Compared 22% of the time

OpenText LoadRunner Professional vs OpenText LoadRunner Cloud

Compared 18% of the time

Oracle Application Testing Suite vs OpenText LoadRunner Cloud

Compared 2% of the time

OpenText UFT One vs OpenText LoadRunner Cloud

Compared 2% of the time

More OpenText LoadRunner Cloud Competitors

Product Reports

Buyer's Guide

Apache JMeter

October 2024

Download Apache JMeter product report

Buyer's Guide

BlazeMeter

October 2024

Download BlazeMeter product report

Buyer's Guide

OpenText LoadRunner Cloud

September 2024

Download OpenText LoadRunner Cloud product report

Also Known As

JMeter

JMeter Cloud

Micro Focus LoadRunner Cloud, StormRunner Load, LoadRunner Cloud, and Micro Focus StormRunner Load

Learn More

Apache

Perforce

OpenText

Overview

Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

What protocols does JMeter support?

Web - HTTP, HTTPS
Web services - SOAP/XML-RPC
Email service - POP3, IMAP, SMTP
FTP service
Database via JDBC drivers
LDAP
Native commands or shell scripts
TCP
Java objects

How does JMeter work?

JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

Apache JMeter Key Features

JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
Command-line mode allows carrying out load tests from any OS compatible with Java.
JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
JMeter is entirely portable.
A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
Thanks to the caching feature, you can conduct offline analysis or replay test results.

Apache JMeter Benefits

As open-source software, it is freely available and continuously improved.
The setup is user-friendly, and no installation is needed.
The GUI (graphic user interface) is intuitive and easy to use.
You can write your own tests and use the visualization plugins to extend the testing.
It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
Since the test plans are stored in XML format, you can generate a test plan using any text editor.
You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

The JMeter extensible core has numerous benefits:

Unlimited testing capabilities via pluggable samplers.
You can choose multiple load statistics with pluggable timers.
Visualization plugins and data analysis enable customization.
Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

Reviews from Real Users

Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

"I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.

The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.

Do your performance and load testing in the cloud. OpenText LoadRunner Cloud makes it easy to plan, run, and scale performance tests without the need to deploy and manage infrastructure.

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape

DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub

Alfa Bank, N Brown Group, University of Copenhagen, McGraw-Hill, Cognizant

Buyer's Guide

Performance Testing Tools

September 2024

Download Free Report

Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools. Updated: September 2024.

DOWNLOAD NOW

813,266 professionals have used our research since 2012.