OpenText LoadRunner Cloud Reviews

We use the solution primarily for executing the load tests.

We are able to see the analysis component, and it automatically generates a report from the tool itself after completing the load test. I like that feature. It has great automated reporting features where the report will be generated from the tool itself.

It's user-friendly and it supports a lot of protocols.

The solution can scale.

The stability is good. 

While executing the test it automatically refreshes and I need to see the downwards component, however, it's not allowing me to see that. since it's automatically refreshing, I'm unable to see all the lines in that tool that we are seeing in the editor window.

We did have some challenges with the initial implementation.

I've used the solution for about one year.

I like the product. It's very stable. There are no bugs or glitches. It doesn't crash or freeze. It is reliable.

We can scale the product as needed. It's very easy to do. 

It's also good for any size of the company, from small to enterprise. 

Right now, I'm the only person that uses the solution in our organization. However, we use it to execute the tests with 800 users.

I use it daily. It's used for a quarterly test. For every quarter we'll be executing the testing required.

Technical support has been good. We find them to be quite helpful and responsive. 

Positive

We initially had some problems with the setup as we had an issue while configuring load generators with the tool. In the end, everything went well. We raised it with the Micro Focus team, and they resolved our issue.

I'd rate the initial setup a four out of five in terms of the ease of implementation. 

We handled the initial setup in-house. We didn't need any outside assistance. 

I'm not aware of the cost. I don't handle that aspect of the product.

My understanding, however, is that it is a little bit pricey. 

We have looked into other tools and find that this tool, although expensive, has many useful features. 

We are just a customer and end-user of the product. 

Even though the cost is expensive, there are good features when compared to all other tools. I'd recommend it to others as something they should use. Of course, it does depend on the applications a company uses. 

I'd rate the solution nine out of ten. 

Our primary use case for the solution is performance testing, validation and baseline testing. We deploy the solution on the cloud.

We find the ease of infrastructure maintenance and the enhanced capabilities of the cloud version, such as browser metrics, valuable.

The product price could be more affordable compared to similar products.

We have been using the solution for approximately three years.

The solution is stable.

The solution is scalable.

The initial setup was straightforward, and it took approximately a day.

I rate the solution a nine out of ten. My advice to users considering this solution is to pay attention to scheduling.

We use it to get response times around the world for external applications. We use it on top of our own virtual users for remote site testing. We include it in our scenarios in our performance center and use the results in the LoadRunner analysis tool.

We can determine response times for our external applications, from most places around the world, for a small fee.

The most valuable feature is having load generators in countries where we don’t have access to them.

An area for improvement is analytics on why response times are slow from certain countries. Slowness can be caused by the laptop, the connection, the VPN, the internal network, the country's internet, etc.

It has been stable every time I have used it. We don’t put much stress on it since we have our own performance center and load generators.

In terms of integration and configuration of the product in our AWS environment, it is the easiest Micro Focus tool I have ever used.

The pricing is very reasonable and the licensing is straightforward.

You decide on the number of virtual users you will need to support multiple runs or for a year and purchase that quality of virtual-user hours. We chose to procure this solution via the AWS Marketplace because of remote site testing and low cost.

I rate this solution a ten out of ten. It addresses a need in performance testing tools and is easy to purchase and use.

The solution is used for load performance testing activities.

The product supports a wide variety of technology compared to any other tool.

The product must improve support. The support team provides delayed responses. Many times, there are a lot of conversations between the support team and the technical team without any conclusions.

I have been using the solution for 14 to 15 years.

The tool is not perfectly stable.

Around 30 to 40 people use the tool in our organization.

The installation is not difficult, but it is a pretty lengthy process.

The product must improve its price. The solution’s price is considerably high. It is the highest in the market.

My company decided to use the product due to the technology support it provided. I would recommend the solution to someone with technology that other tools couldn’t support. Overall, I rate the solution a six out of ten.

I have been using the solution for testing Salesforce and a few other applications.

The solution has improved the performance of the software.

The solution is intuitive, easy to use and navigate.

They should minimize the use of coding for the solution. Also, they should include features to import other scripts without rewriting them.

I have been using the solution since 2019.

It is a stable solution.

The solution is scalable. I rate its scalability between a seven and nine out of ten.

The solution's technical support has been good.

Positive

We have used StormRunner and JMeter before. Also, we are doing a proof-of-concept for NeoLoad.

The solution's setup process was easy. Although, we encountered a few issues sometimes.

The solution is expensive. There should be a version that optimizes the price-to-performance ratio for the service package.

The solution is costly. I rate it a nine out of ten.

The reason we chose it and the most valuable feature is the amount of virtual users we can run in a test. We have run up to 900,000 users.

We do online testing for the States as we have contracts with them. We have to be able to support a certain number of students, so this helps us confirm and validate that we can support the number of students that are taking online testing at one time.

I think the reporting could be better. I think you could have a little more variety of reports. Right now, you get an email saying, "Here's your report". You can't put in the analysis tool. You can't export it to Excel. Those are the things that would make it a little better. That's probably my biggest pain point, it is the reporting.

I think it's fairly stable. There's some features that I think could be made better but, for what they have, I think what they have works well.

I think it scales really well. I like that you can add users on the fly or remove users on the fly. That's a great feature.

I have used the support. We were one of the first users for Beta, so we have a relationship with the developers, so we tend to just go right to them when we have questions or problems.

They've been great. A lot of the times, it's not really a problem with StormRunner, it's just our understanding of what it's supposed to do, so they are very great about explaining the reasoning and what will be coming in the future. If we don't think that's really what we want, they'll explain how it's in the roadmap and how it's going to be made better.

We were using another HPE product, Performance Center. We haven't totally switched, but StormRunner Load is our option for the test where we need a lot of virtual users where we can run it in the cloud. Whereas, on Performance Center, you have to have load generators in-house, or what HPE provides. That's why we use it. It's for when we want to use a lot and perform a big test.

I wasn't involved in the deployment.

Not really because we're mostly an HPE shop and this was working with HPE they to meet our needs, so they provided this and it's worked out great.

I don't like their reporting. Other than that, I think it's great. It does what it's supposed to do and I know it's just the beginning, so there's going to be a lot more features added.

You should look into it. I know there are other solutions that have more bells whistles, but,when it actually comes down to function, I think StormRunner does the job.

StormRunner Load reduces the overall time for performance testing engagement and is best suited for the products in agile process. Easy to automate and execute the tests, StormRunner Load provides a feature to compare the current test results with the previous results to see if the current build is better than the previous or not.

With the ability to integrate with monitoring tools like SiteScope and APM tools like New Relic, performance bottlenecks in the applications can be identified very quickly and easily.

Protocol Support

StormRunner Load supports Web, Web Services, SAP Web and JMeter scripts

Easy Automation

StormRunner Load uses Truclient and TruAPI (which uses node.js) which enables developers and testers to quickly automate the user actions at the browser level, which also helps measuring the end user experience by measuring the browser rendering times as well. Performance testers can upload their LoadRunner scripts that are developed using LR 12.XX to StormRunner Load directly.

High Scalability

StormRunner Load is highly scalable and supports upto 1 million concurrent users.

On Premise Load Generators

StormRunner Load introduces the concept of On Premise Load Generators to compare the application performance within the network to various other geographical locations.

Configure SLAs

SLAs can be configured in StormRunner Load during the test execution. The tool highlights all the transactions that did not meet the SLAs and further drill down can help the users understand the geographical locations and times where the SLAs are not met.

Real time anomaly detection

During the test execution, StormRunner Load detects any anomalies where the test results are deviated for a specific transaction / geographical location / script / counter to identify the issues real time and further drill down provides more details about the anomalies.

Integration with Monitoring Tools

StormRunner Load integrates with monitoring tools like SiteScope to provide the hardware and application level metrics during the performance tests. StormRunner Load can also integrate with New Relic and other similar APM tools that helps identifying the server side bottlenecks so that organization can reuse investments

HP StormRunner Load has provided us a) flexibility for on demand load generation b) reduced over all TCO on our load testing efforts c) Reduced the skill level to develop load test scripts.

Custom load patterns for the performance tests: Currently StormRunner Load supports only linear ramp up of the user load and doesn’t provide the user load to follow a step incremental load pattern or any other pattern that a performance tester wants to.

Load distribution among on premise LGs: StormRunner Load currently supports load generation from only one of the On premise load generators and the user load cannot be distributed to multiple on premise LGs.

Simulation of latencies: There is no provision to simulate network latencies to simulate realistic geographical locations and mobile networks.

Ability to create custom reports: StormRunner Load provides only the default reports and there is no provision available currently to generate the custom reports

Backward compatibility: StormRunner Load expects the LoadRunner scripts that are generated from LR 12.00 and above. Any scripts developed using the older versions are not supported.The work around to overcome this problem is to open the scripts in LR 12.00 or higher and save it again before uploading to StormRunner Load..

We have used the product for more than 14 weeks now and tested on some of our internal applications in the organization that would require performance testing.

HP StormRunner Load doesn’t need any installation or deployment unless you wanted to configure few on premise load generators. Configuring on premise load generators is pretty straight forward. All that you need is to have an account with HP SaaS to start using StormRunner Load.

HP SaaS web application is pretty stable and no issues were seen during the evaluation process.

There were no issues with the scalability, however, the time taken to initialize the test is directly dependent on the number of users to be simulated.

5/5.

The support provided to us very good which helped us to evaluate the solution for our context.

We are in the process of adopting a SaaS based option, this led us to evaluate a bunch of tools.

It is simple - just registering with HP SaaS platform called pronq.com.

We evaluated through our in-house resources.

Our estimated ROI is positive we need a couple of months to gain insight into actual ROI.

HP StormRunner load is SAAS offerings so the initial setup costs are very minimal when compared to the traditional approach (no or minimal capex ), and the day to day costs would be purely driven by the duration and number of virtual users required to simulate the traffic.

We have evaluated HP StormRunner Load against other market competitors that include Blazemeter, SOASTA’s Cloud Test, NeoLOAD, VSTS, Load Complete and StressStimulus.

HPStormRunner load is an apt product a) if your application stack has Web 2.0 traffic b) your requirement is for a service that allows for pay as you go model c) proven and reliable load testing solution with superior support.

This review was co-authored by Sravanthi Naga & Ramanjaneyulu Narra, Performance Architects at Gallop Solutions. Gallop is a US based Co-located Independent Testing Services operating since 2003 with offices in Philadelphia & California. World's largest and leading organizations have relied on Gallop's specialist independent software testing services for more than a decade and have achieved significant market acceleration, returns on investments in their software quality initiatives.

The platform is easy to use for uploading and backing up scripts.

I had to do overload testing on our homepage. I couldn’t use our regular tools because I wanted to simulate a real scenario and StormRunner Load does this. It enabled us to upload the scripts into the cloud and gave me unlimited resources.

The monitoring abilities were lacking. The reporting didn’t present the information in a clear manner for me. It took me four days to understand why I couldn’t upload the scripts from my computer to the cloud, and I discovered I was missing an important feature that StormRunner Load is missing, called Corver, and this converts the script for the tests.

I used it once in a testing session and have been using it for one month in a live environment.

No issues encountered.

There was a bug and we opened a ticket with HP, and it was fixed after a few days.

No issues encountered.

It was great, there was an issue and I worked with Kim from HP who was great.

It was great.

No previous solution used.

It was straightforward, we just needed to register on the site. In comparison to other HP products, it was very user-friendly.

We did it in-house.