OpenText LoadRunner Cloud vs Sauce Labs comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

OpenText LoadRunner Cloud
Average Rating
8.2
Number of Reviews
40
Ranking in other categories
Performance Testing Tools (6th), Load Testing Tools (6th)
Sauce Labs
Average Rating
8.8
Number of Reviews
113
Ranking in other categories
Functional Testing Tools (11th), Test Automation Tools (13th)
 

Market share comparison

As of June 2024, in the Performance Testing Tools category, the market share of OpenText LoadRunner Cloud is 8.0% and it decreased by 20.8% compared to the previous year. The market share of Sauce Labs is 3.8% and it decreased by 12.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Performance Testing Tools
Unique Categories:
Load Testing Tools
7.1%
Functional Testing Tools
6.3%
Test Automation Tools
3.0%
 

Featured Reviews

HM
May 26, 2023
Has good scalability, is intuitive, and is easy to use and navigate
I have been using the solution for testing Salesforce and a few other applications The solution has improved the performance of the software. The solution is intuitive, easy to use and navigate. They should minimize the use of coding for the solution. Also, they should include features to…
AnupKumar4 - PeerSpot reviewer
Apr 9, 2024
Offers good stability and robust but lacks generative AI capabilities
Technical support is equally very important. If you talk about anything deployed to production, and the project is live, customers are using that, and they might face some issues, some functional issues. That's when support people play a role in identifying the fix or the incident. Based on that, we create an incident based on the customer defect or whatever. Once the incident gets raised, the support will play a role in working on that particular incident. If it's a code-based incident, administration, or integration issue, support people play a big role in resolving those issues before reaching the exact developers.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It's a fast product, so you don't have much trouble in terms of maintenance overhead. You don't want to just look into configuring load generators, look for upgrades, and end up having that take up a lot of your time. With this solution, you just log in and you start using it. This means that there is a huge benefit in terms of the overhead of maintaining the infrastructure and the maintenance effort."
"OpenText LoadRunner Cloud eliminates the need for our own testing infrastructure when running tests."
"The record and playback feature is the most valuable feature. It's all driven by the script, so it's a script-based tool where the background tracing starts. Java's background process does a lot of tracing. The process starts in the background. It sees what peaks of volumes that the process can handle. It's easy to use because it's script based, record, and playback. I"
"The product supports a wide variety of technology compared to any other tool."
"It's fast, easy to use, has a user-friendly UI, and you can split users."
"The usability and ability to integrate with other solutions is quite good. When I use it in on Azure, then Red Hat is the most likely solution I use. When I use AWS, then I tend to use Lambda functions. In either case, it works well and you can use it either way."
"The reports are very relevant to the customers’ expectations."
"The product’s most valuable feature is the Vuser license; it allows us to reduce the cost as per requirement."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"Testing across multiple devices and environments is now possible to do quickly and effectively."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"As stated earlier we use Sauce Labs for a combination of automated testing and manual testing. Therefore the most useful features are the ability to run the functional automated tests via a Sauce Labs tunnels which allows access to applications in our internal network. The second most useful feature is the manual side."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"They offer a large number of devices and browser/operating system combinations for real device tests"
 

Cons

"Improvements to the reporting would be good."
"There is a steep learning curve for the product, too."
"There are three modules in the system that are different products packaged into one, and they can sometimes be difficult to figure out, so they should be better integrated with each other."
"Some improvements can be made to the solution's user interface"
"In terms of new features, they can natively integrate with Chaos engineering tools such as Chaos Monkey and AWS FIS. With LoadRunner, we can generate load, and if Chaos tools are also supported natively, it will help to get everything together."
"One area for improvement in LoadRunner Cloud, especially for agile models, is its limited support for functional testing alongside its robust non-functional testing capabilities."
"The support team provides delayed responses."
"We are trying to put it into a complete CI/CD pipeline, but there are still some challenges when you try to run it through different protocols. The challenges are around how you can containerize applications. There are some limitations to some protocols, such as desktop. And when it comes to database testing, there are some things that we can't do through CI/CD."
"The ability to configure the memory and CPU for the test machines should be included."
"Progress towards reducing application testing time can be made."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers.​"
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
 

Pricing and Cost Advice

"The solution is expensive."
"It is expensive compared to other tools."
"The pricing for OpenText LoadRunner Cloud is average."
"Pricing is dependent on what you're referring to. If you're talking about the cloud, it's likely competitive. However, if you're talking about the on-premise version, professional or enterprise licenses are required. Prices are on the high side. They are not cheap."
"LoadRunner always had expensive pricing. At my company, we used to evaluate LoadRunner, but we stuck with Silk Performer because its pricing was always better in the past. I do feel that I got a fair deal this time. Our value-added reseller and our sales guy worked hard to give us a fair deal. I feel that we got a fair deal. We did not go for the pay-as-you-go deal. I did an upfront package. I prefer that. I want to know what my costs are."
"The pricing is very reasonable and the licensing is straightforward."
"We make use of virtual user hours. We buy time in the LoadRunner Cloud. It costs around $80,000."
"The solution’s price is considerably high."
"Their pricing is incredibly competitive."
"Go ahead please. Try it at a smaller scale."
"We have an enterprise account; it has worked great for our needs."
"With respect to pricing, they did a bundled discount because we went with Sauce Labs for both mobile and browser. They were very competitive on pricing and provided a bundle discount for us as a larger customer."
"​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
"When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
"Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."
"We pay for a specific number of VMs."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
787,061 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
21%
Computer Software Company
14%
Manufacturing Company
10%
Government
8%
Financial Services Firm
18%
Computer Software Company
17%
Healthcare Company
6%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Do you recommend Micro Focus LoadRunner Cloud?
I absolutely recommend Micro Focus LoadRunner Cloud. In fact, I consider it to be one of the best performance testing tools. I like it because it provides many benefits. Some of the ones I find to...
What do you like most about Micro Focus LoadRunner Cloud?
One of LoadRunner's standout features is its extensive support for various TechStacks and protocols.
What is your experience regarding pricing and costs for Micro Focus LoadRunner Cloud?
The solution is a bit expensive. The pay-as-you-go model offered by LoadRunner Cloud is important to us, especially when considering the cost-effectiveness of performance testing.
What do you like most about Sauce Labs?
It has significantly enhanced our testing accuracy by approximately 50%.
What needs improvement with Sauce Labs?
Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. For example, in my current project, we reduced the time it took to complete user...
What is your primary use case for Sauce Labs?
I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java. I have also worked with Docker integration on AWS. Additionally, I have experie...
 

Also Known As

Micro Focus LoadRunner Cloud, StormRunner Load, LoadRunner Cloud, and Micro Focus StormRunner Load
No data available
 

Overview

 

Sample Customers

Alfa Bank, N Brown Group, University of Copenhagen, McGraw-Hill, Cognizant
Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools. Updated: May 2024.
787,061 professionals have used our research since 2012.