OpenText LoadRunner Cloud Reviews

The most valuable feature is the ability to configure browser settings for different operating systems and on different versions without the need to install every single version on each machine and to manage them. This is the most useful feature that I'm interested in.

I'm also interested in mobile center services related to StormRunner functions because we are going to determine which will be the best solution for developing mobile testing. And we are interested in outsourcing mobile testing, so this kind of environment will be useful as we are not engaged in the configuration of infrastructure. Also, I think it will be useful because Storm Runner functionality does not need specific configuration because the configuration basis is in the UFT and the UFT can be in our environment. We do a lot of configuration because we develop a custom framework related to UFT. So, I appreciate that configuration can be managed by us, while the browser can be released on the remit version.

I'd like to see more ability to dive more deeply into the configuration.

I think the product is still immature because we have some problem reaching the mobile center connection related to a proper configuration on our machine. In fact, we are in touch with the R&D team to fix the configuration for our environment. I also think that it will be useful to have an object recognition tool because the specific configuration on the browsers are to be managed so as to fix our specific test. I need to recognize what was the configuration on the remit browser and I need a tool to analyze the impact of the browser configuration on the test.

I think the scalability is fine with this kind of solution because I have no problem with how many machines will be available to run the test; it's a matter of the cloud provisioning. It will be useful to run the tests in multiple environments in parallel. That will be a good tool for us when we have to make tests with a shortage of time.

I have not used technical support recently. HPE support is always prompt to solve the issues. That is the main thing I appreciate regarding support.

Flexibility and speed to provision and start large (high concurrency) performance testing cycles.

This software solution has allowed us to run larger, high concurrency performance testing cycles in a very repetitive manner…a requirement for validating our application solutions and supporting infrastructure for customer facing web apps.

Out of the box reporting could be improved.

We have been using the solution for 9 months.

Some issues with UI but HP did provide high levels of support and the issue(s) were quickly fixed (within 3 days of initial product usage).

No issues with stability.

No issues with scalability.

Customer service was an 8/10.

Technical support 9/10.

Utilized a different HP toolset (ALM/PC) for performance testing. SRL provided a better solution from a pricing and scaling perspective.

Initial setup was straightforward…cloud based solution with a simple, flexible UI.

Vendor team…expertise (10).

Looked briefly at Neotys…actively doing a POC of CloudTest for comparison purposes.

You need to effectively plan anticipated usage of the toolset. This will enable you to purchase the appropriate amount of Vusers hours for your contractual period (in our case this was 12 months).

It's very valuable because with StormRunner we can validate the capacity of our systems. Specifically, we use it for one system that is from two years ago. We have an increment of the users, about 300% more, so we need to assure that the quality of the service keeps up with the users. StormRunner helps us to validate that.

Right now, we are just starting to use it. I don't have any comments on that.

Less than a year.

Yes, it's stable. We don't have any issue right now with the performance or anything like that.

It's very flexible. We can have load testing for 100 users, maybe 1,000 or even more, so yes, no problem with that.

It's very good. We also have support from our partner, Micro Focus, so it's basically good on that.

No, it was straightforward. It was very easy to implement and to have a load test.

It's in the cloud. Everything goes in the cloud. We needed something that's easy to set up in the cloud so we can use it directly there.

It's very easy to set up a load test, to start it and end it. It is valuable that it is very easy to use.

We are not benefitting a lot at this time because it has its bad parts.

It needs more features; a lot more features. Everything that's in LoadRunner Analysis should be built up in StormRunner; so we can use everything, every functionality and every feature all together.

It's stable. It's not perfect, but it's stable.

It is not really scalable.

We didn't use it that much. It was a demo session set up especially for us.

It's very east to set up. I did it directly myself just once.

We compared it to LoadRunner and Performance Center because we use that currently for load and performance tests. We cannot use this solution in the cloud. StormRunner is very rudimentary at this time, but it's a great concept. We hope that it will be thrilling.

We chose StormRunner because of the cloud. That's a great part of it.

Wait with StormRunner.

• The fact that you don't have to worry about the infrastructure setup.
• The fact that 1000's of virtual users can log on to the cloud without having to set up.
• Provides a solution for new or existing customers.
• Alternative to LoadRunner, for new or existing clients with agile.

At the moment, its a bit early for us to tell - does everything we need it to. HP is looking to expand to see what exactly it can be used for.

We did a trial since it was launched.

No issues with deployment.

No issues with stability.

We were only running a small set of numbers, but no issues.

It's not something we've really had to worry about - we were able to crack it open and begin.

The help files on the web are good and the video links/ guides are good.

We use LoadRunner extensively for Performance testing.

Setup was straightforward.

In-house implementation.

I can't calculate the ROI right now but I would assume a lot considering savings on infrastructure cost and license costs. It will still take some time to run a performance test but setup saves a lot of time.

We evaluate a lot of testing tools. NeoLoad, LoadRunner, we prefer HP.

If you're looking at an application that can be seen on the WAN and using agile approach, then its a tool that should be recommended and used.

• The ability to spin upload really fast.
• The ability to create a script easily against an application.
• The ability to provision the load so it comes from multiple geographies across the world. 

The documentation could absolutely be improved and scripts. For example, during a performance test, the monitoring graph is not very clear as to what its representing. I wasn’t sure what the graphs represented so my guess is a lot of customers feel the same way.

One month - were doing a trial.

No issues.

No, the only thing I remember seeing as a “bug” when you hover your mouse over the graph, it will jumps around and doesn’t follow the mouse movement, other than that I don’t remember seeing anything from a stability perspective.

No, but haven’t really scaled it yet.

That's where the documentation could be really helpful, apparently I had an older version on my machine, which was creating conflict. If everything had gone as supposed to would have been simple but the documentation could have better and clearer.

Customers should understand the amount of time it takes to build a script - benefit of StormRunner as opposed to other cloud based Load testing tools is the ease of scripting. End users should understand the impact of the time it takes to build scripts. If StormRunner can save you 50% of your scripting, you need to understand how that translates into value. Expertise of StormRunner and LoadRunner includes these elements.

This solution is SaaS based so we can utilize cloud technology, which is less time consuming and saves a lot of of money.

Sometimes, you are utilizing one of the low generators, then all of a sudden if you discontinue from one project, it actually deletes the entire low generator. You have to go through all the setup again. This kind of problem is on and off. It comes and goes.

We have just been using it for about two months now.

This is a new product, so there are a couple of flaws, sometimes things act up weirdly. We reach out to the support group, they solve the issues. It's an ongoing process. We understand that.

Since this is a new solution, they need to improve the support. They also have some lack of expertise. We understand that.

It is complex. You need to convince the leadership and the IT security team. You need to solve all these issues. There are a lot of things that you have to go through.

We chose this one because of the name. It's established, the last decade. We used to be with this company. Micro Focus is more than seven or eight years, we're good with them, they are good with us.

It's a new product and we are facing some issues. We believe, they are going to work out at their end. They are going make it work and fix everything, whatever the flaws are now.

Overall, we are using this to save money and utilize the cloud technology.

• Ability to get started on the fly
• Reusability of existing HTTP/HTML scripts

I have been able to run several tests from outside the corporate LAN, which in the past used to be an infrastructure nightmare as it required opening up ports, disabling firewalls, etc.

It needs the ability to execute other protocols, especially the TruClient for Firefox without having to convert them.

We've used it for over a year.

There have been no issues with the deployment.

We have had no stability issues.

It's scaled to our needs.

Customer Service is immaculate.

Tech Support is immaculate.

There was no solution in place previously.

There was no set-up required.

It's done in-house, but there's no actual implementation needed.

There pricing and licensing options are very aggressive, but the holiday discount brought down the price further.

I think that StormRunner Load is the way forward and if HPE manages to support all protocols currently supported by LoadRunner/Performance Center eventually in StormRunner, it would be a massive game changer.