Apache JMeter vs OpenText LoadRunner Cloud comparison

Apache JMeter

Read 82 Apache JMeter reviews

7,680 Views
6,266 Comparison Views

87% willing to recommend

OpenText LoadRunner Cloud

Read 40 OpenText LoadRunner Cloud reviews

4,560 Views
2,707 Comparison Views

92% willing to recommend

Apache JMeter

OpenText LoadRunner Cloud

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Apache JMeter and OpenText LoadRunner Cloud based on real PeerSpot user reviews.

Find out in this report how the two Performance Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.

To learn more, read our detailed Apache JMeter vs. OpenText LoadRunner Cloud Report (Updated: May 2024).

Buyer's Guide

Apache JMeter vs. OpenText LoadRunner Cloud

May 2024

Download the complete report

Helped 787,061 peers since 2012

Categories and Ranking

Apache JMeter

Ranking in Performance Testing Tools

1st

Ranking in Load Testing Tools

1st

Average Rating

7.8

Number of Reviews

Ranking in other categories

API Testing Tools (3rd)

OpenText LoadRunner Cloud

Ranking in Performance Testing Tools

6th

Ranking in Load Testing Tools

6th

Average Rating

8.2

Number of Reviews

Ranking in other categories

No ranking in other categories

Market share comparison

As of June 2024, in the Performance Testing Tools category, the market share of Apache JMeter is 29.5% and it increased by 43.9% compared to the previous year. The market share of OpenText LoadRunner Cloud is 8.0% and it decreased by 20.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Performance Testing Tools

Unique Categories:

Load Testing Tools

27.6%

API Testing Tools

4.8%

Featured Reviews

Alexey Nadenenko

Solution Architect at EPAM Systems

Apr 2, 2024

Helps identify bottlenecks by measuring response times whle we increase request flow rates

Apache JMeter's key feature is its ability to manage load profiles, gradually increasing requests over time. This was crucial for us as we tested our application, handling unique protocols and increasing load steadily. JMeter helped identify bottlenecks by measuring response times as we increased…

Read full review

AlexLogan

Senior Manager, Performance Engineering at Enel Group

Jun 3, 2024

Has realistic scenario composition for performance tests and is highly scalable, but the user interface needs improvement

The solution generates traffic on the infrastructure, which resembles end users. Depending on the performance of the underlying infrastructure and nodes of the architecture, our company team can report on the scalability of applications. The solution performs two types of tests: user interface testing, which is implemented primarily in our organization for online banking, and the other one is API level testing for mobile banking. In terms of the feature set, OpenText LoadRunner Cloud is a market-leading application that has been around for 20 years. I have been working with the solution throughout the acquisition stages; the product used to be much better when it was primarily managed by Mercury. There are limited AI capabilities in the solution; when I was personally operating some smart scenarios using the feature of auto-scaling, I found it unsatisfying. I would recommend the product to others based on its feature set and the level of support. I would rate OpenText LoadRunner Cloud as seven out of ten. There are no glaring weaknesses in the product, and it's good enough for its core purpose.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"I like the fact that JMeter integrates well with other tools."

"The most valuable features are the integration with Jenkins and the reporting."

"The metrics part of it and the ability to write your custom code to do some specific tests in the performance testing space are the most valuable features."

"It's very easy to install, and it's very easy to code and develop the script."

"It is easy to set up."

"It is cost-effective and simple to use."

"I appreciate JMeter's simplicity and power for performance testing."

"The most valuable feature for us is the available information on the forums and to be able to discuss and get answers from the people that are involved in using this tool."

More Apache JMeter pros

"The fact that the solution supports multiple protocols such as open source, VuGen, TruWeb, TruClient, and SAP is very important because these protocols help us to concentrate on what is really needed to produce performance tests. If something is not supported, you have to use other tools or find other ways of assimilating loads."

"The beauty of LoadRunner Cloud is that we can use the load generator that is hosted by us on-premises, and we also have the option to use their hosted load generator. If it is a public-hosted application, we can also use their public-hosted load generator, but in our case, all our applications are hosted in our data center, so we are using the on-premise load generator. We have the option to deploy those load generators as we want."

"The most valuable feature is having load generators in countries where we don’t have access to them."

"It's a fast product, so you don't have much trouble in terms of maintenance overhead. You don't want to just look into configuring load generators, look for upgrades, and end up having that take up a lot of your time. With this solution, you just log in and you start using it. This means that there is a huge benefit in terms of the overhead of maintaining the infrastructure and the maintenance effort."

"The initial setup was straightforward."

"The TruClient feature is the most valuable for us. An application with testing can only be scripted using TruClient, so it's part web-based, but it also has its own protocol combined with HTTP and HTML. So many other tools do not recognize this specific proprietary protocol. Using TruClient, we can still create scripts that cover everything that we need to cover."

"The most valuable feature is that you can create an infrastructure on-demand and do performance testing with it."

"The reports are very relevant to the customers’ expectations."

More OpenText LoadRunner Cloud pros

Cons

"Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."

"Apache JMeter could be a more user-friendly product from the end user's perspective."

"It has some proxy-based dependencies which require specific proxies to be set up or disabled, which causes problems."

"We're like the solution to be more user-friendly."

"The user interface is a little bit tricky."

"The only thing is the learning curve. It's high."

"The reporting section of the solution can be better."

"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."

More Apache JMeter cons

"I'd like to see more ability to dive more deeply into the configuration."

"It doesn't provide custom reports. You can only use the default reports which contain irrelevant data or is missing data that we need."

"The support team provides delayed responses."

"There is a steep learning curve for the product, too."

"There are three modules in the system that are different products packaged into one, and they can sometimes be difficult to figure out, so they should be better integrated with each other."

"One area for improvement in LoadRunner Cloud, especially for agile models, is its limited support for functional testing alongside its robust non-functional testing capabilities."

"Its scripting features need improvement."

"We are trying to put it into a complete CI/CD pipeline, but there are still some challenges when you try to run it through different protocols. The challenges are around how you can containerize applications. There are some limitations to some protocols, such as desktop. And when it comes to database testing, there are some things that we can't do through CI/CD."

More OpenText LoadRunner Cloud cons

Pricing and Cost Advice

"We are using the free version, and if required, we can easily switch to the other version."

"I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."

"The solution is free of cost as it is open source."

"This is an open-source solution, and there are no fees."

"Free"

"Apache JMeter is a free tool."

"It is open source. There are no licensing costs associated. If you need enterprise support, you'll probably end up paying for a license. You would also factor in the infrastructure cost, but that's not significant."

"The solution is open source with no user fees or licenses."

More Apache JMeter pricing and cost advice

"There is no monthly or yearly cost but rather, the fees are based on the amount of traffic that you use."

"LoadRunner always had expensive pricing. At my company, we used to evaluate LoadRunner, but we stuck with Silk Performer because its pricing was always better in the past. I do feel that I got a fair deal this time. Our value-added reseller and our sales guy worked hard to give us a fair deal. I feel that we got a fair deal. We did not go for the pay-as-you-go deal. I did an upfront package. I prefer that. I want to know what my costs are."

"It is neither costly nor cheap. It is not too high and not too low. I know the price of other tools, and LoadRunner Cloud's price is in the medium range."

"It's a very expensive solution"

"The solution’s price is considerably high."

"The pricing is very reasonable and the licensing is straightforward."

"The solution is expensive."

"Pricing is dependent on what you're referring to. If you're talking about the cloud, it's likely competitive. However, if you're talking about the on-premise version, professional or enterprise licenses are required. Prices are on the high side. They are not cheap."

More OpenText LoadRunner Cloud pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.

See recommendations

787,061 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

18%

Computer Software Company

17%

Manufacturing Company

Government

Financial Services Firm

21%

Computer Software Company

14%

Manufacturing Company

10%

Government

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

How does Postman compare with Apache JMeter?

Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...

See all answers

How does BlazeMeter compare with Apache JMeter?

Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...

See all answers

What do you like most about Apache JMeter?

I appreciate JMeter's simplicity and power for performance testing.

See all answers

Do you recommend Micro Focus LoadRunner Cloud?

I absolutely recommend Micro Focus LoadRunner Cloud. In fact, I consider it to be one of the best performance testing tools. I like it because it provides many benefits. Some of the ones I find to...

See all answers

What do you like most about Micro Focus LoadRunner Cloud?

One of LoadRunner's standout features is its extensive support for various TechStacks and protocols.

See all answers

What is your experience regarding pricing and costs for Micro Focus LoadRunner Cloud?

The solution is a bit expensive. The pay-as-you-go model offered by LoadRunner Cloud is important to us, especially when considering the cost-effectiveness of performance testing.

See all answers

Comparisons

BlazeMeter vs Apache JMeter

Compared 32% of the time

Postman vs Apache JMeter

Compared 22% of the time

Tricentis NeoLoad vs Apache JMeter

Compared 12% of the time

OpenText LoadRunner Professional vs Apache JMeter

Compared 4% of the time

Visual Studio Test Professional vs Apache JMeter

Compared 1% of the time

More Apache JMeter Competitors

OpenText LoadRunner Enterprise vs OpenText LoadRunner Cloud

Compared 28% of the time

Tricentis NeoLoad vs OpenText LoadRunner Cloud

Compared 27% of the time

OpenText LoadRunner Professional vs OpenText LoadRunner Cloud

Compared 20% of the time

BlazeMeter vs OpenText LoadRunner Cloud

Compared 10% of the time

Oracle Application Testing Suite vs OpenText LoadRunner Cloud

Compared 3% of the time

More OpenText LoadRunner Cloud Competitors

Product Reports

Buyer's Guide

Apache JMeter

June 2024

Download Apache JMeter product report

Buyer's Guide

OpenText LoadRunner Cloud

May 2024

Download OpenText LoadRunner Cloud product report

Also Known As

JMeter

Micro Focus LoadRunner Cloud, StormRunner Load, LoadRunner Cloud, and Micro Focus StormRunner Load

Learn More

Apache

OpenText

Overview

Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

What protocols does JMeter support?

Web - HTTP, HTTPS
Web services - SOAP/XML-RPC
Email service - POP3, IMAP, SMTP
FTP service
Database via JDBC drivers
LDAP
Native commands or shell scripts
TCP
Java objects

How does JMeter work?

JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

Apache JMeter Key Features

JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
Command-line mode allows carrying out load tests from any OS compatible with Java.
JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
JMeter is entirely portable.
A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
Thanks to the caching feature, you can conduct offline analysis or replay test results.

Apache JMeter Benefits

As open-source software, it is freely available and continuously improved.
The setup is user-friendly, and no installation is needed.
The GUI (graphic user interface) is intuitive and easy to use.
You can write your own tests and use the visualization plugins to extend the testing.
It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
Since the test plans are stored in XML format, you can generate a test plan using any text editor.
You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

The JMeter extensible core has numerous benefits:

Unlimited testing capabilities via pluggable samplers.
You can choose multiple load statistics with pluggable timers.
Visualization plugins and data analysis enable customization.
Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

Reviews from Real Users

Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

"I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

Do your performance and load testing in the cloud. OpenText LoadRunner Cloud makes it easy to plan, run, and scale performance tests without the need to deploy and manage infrastructure.

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape

Alfa Bank, N Brown Group, University of Copenhagen, McGraw-Hill, Cognizant

Buyer's Guide

Apache JMeter vs. OpenText LoadRunner Cloud

May 2024

Free Report: Apache JMeter vs. OpenText LoadRunner Cloud

Find out what your peers are saying about Apache JMeter vs. OpenText LoadRunner Cloud and other solutions. Updated: May 2024.

DOWNLOAD NOW

787,061 professionals have used our research since 2012.

See our Apache JMeter vs. OpenText LoadRunner Cloud report.

See our list of best Performance Testing Tools vendors and best Load Testing Tools vendors.

We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.