OpenText LoadRunner Cloud Reviews

The charts dashboard, especially the results screen, is the most valuable feature. I’ve also configured the tests, so I’ve also used the test definition page, which is very easy to use, self-explanatory, and simple. The real value comes from the results screen.

StormRunner Load helped us evaluate the performance of the product version we were about to launch. It showed us bottlenecks, where our product reaches its limits, and different characteristics that affect this. For example, we had metrics we thought were affecting our response time. Initially we thought there were two metrics, but we found another significant metric we should have taken into account. Without StormRunner Load we wouldn’t have known about this "missing" metric.

I think the report page could be improved, although we have used the reporting feature. It wasn’t accurate enough to use as a report that I could send my managers. I had to take additional screenshots to help fill in the reporting. I actually, ultimately, generated a report on my own.

I've been using it for two months.

No issues encountered.

No issues encountered.

No issues encountered.

There was no previous solution in place.

This solution immediately helped us to determine the priorities for what to develop next and where we would reach our limits. Because we had a clear prediction, we knew when it would be urgent to develop features, in various cases. Before StormRunner Load, we didn’t have a clear developer roadmap, and now its very clear where we should invest, our weakest links, and what we need to do to strengthen weak links.

If you’re using third-parties for networking, cloud based servers, load balancer, VPN providers etc., all of them should be informed about the expected load. We had a VPN provider that was expecting thirty users per hour and calibrated accordingly, and the minute we started our load test it shut down. This third-party was not ready. Once we informed them that we were increasing our load, they increased their ability to support the load test.

No, this was my first choice.

It is very cost effective to start with a low number of virtual users for a short amount of time in order to verify that your company system is running properly. Start with a small load test, run it until completion, verify that you see the logs you intended to see, and all people involved in the environment are ready to see what they expected.

• The ability to spin upload really fast.
• The ability to create a script easily against an application.
• The ability to provision the load so it comes from multiple geographies across the world. 

The documentation could absolutely be improved and scripts. For example, during a performance test, the monitoring graph is not very clear as to what its representing. I wasn’t sure what the graphs represented so my guess is a lot of customers feel the same way.

One month - were doing a trial.

No issues.

No, the only thing I remember seeing as a “bug” when you hover your mouse over the graph, it will jumps around and doesn’t follow the mouse movement, other than that I don’t remember seeing anything from a stability perspective.

No, but haven’t really scaled it yet.

That's where the documentation could be really helpful, apparently I had an older version on my machine, which was creating conflict. If everything had gone as supposed to would have been simple but the documentation could have better and clearer.

Customers should understand the amount of time it takes to build a script - benefit of StormRunner as opposed to other cloud based Load testing tools is the ease of scripting. End users should understand the impact of the time it takes to build scripts. If StormRunner can save you 50% of your scripting, you need to understand how that translates into value. Expertise of StormRunner and LoadRunner includes these elements.

This solution is SaaS based so we can utilize cloud technology, which is less time consuming and saves a lot of of money.

Sometimes, you are utilizing one of the low generators, then all of a sudden if you discontinue from one project, it actually deletes the entire low generator. You have to go through all the setup again. This kind of problem is on and off. It comes and goes.

We have just been using it for about two months now.

This is a new product, so there are a couple of flaws, sometimes things act up weirdly. We reach out to the support group, they solve the issues. It's an ongoing process. We understand that.

Since this is a new solution, they need to improve the support. They also have some lack of expertise. We understand that.

It is complex. You need to convince the leadership and the IT security team. You need to solve all these issues. There are a lot of things that you have to go through.

We chose this one because of the name. It's established, the last decade. We used to be with this company. Micro Focus is more than seven or eight years, we're good with them, they are good with us.

It's a new product and we are facing some issues. We believe, they are going to work out at their end. They are going make it work and fix everything, whatever the flaws are now.

Overall, we are using this to save money and utilize the cloud technology.

I have been using LoadRunner Cloud for performance testing.

LoadRunner Cloud allows us to do performance testing without having to create our own physical infrastructure and set up a load generator. Normally, these steps would be required.

The most valuable feature is that you can create an infrastructure on-demand and do performance testing with it. There is no need to create physical infrastructure.

Using this solution does not require the use of a load generator.

Improvements to the reporting would be good.

Technical support can be improved.

I have used LoadRunner Cloud in only one project so far, for a period of about three months.

I have found this to be a very stable product.

I only needed to simulate 40,000 users for my project but I understand that it will work for up to 2,000,000 users. That is huge and I can say that scalability is very good.

This vendor, Micro Focus, is not very good at technical support.

I have used some open-source tools and LoadRunner Cloud is more straightforward to use.

The initial setup is normal and I have not found any complexity with it.

I would rate this solution an eight out of ten.

It's very valuable because with StormRunner we can validate the capacity of our systems. Specifically, we use it for one system that is from two years ago. We have an increment of the users, about 300% more, so we need to assure that the quality of the service keeps up with the users. StormRunner helps us to validate that.

Right now, we are just starting to use it. I don't have any comments on that.

Less than a year.

Yes, it's stable. We don't have any issue right now with the performance or anything like that.

It's very flexible. We can have load testing for 100 users, maybe 1,000 or even more, so yes, no problem with that.

It's very good. We also have support from our partner, Micro Focus, so it's basically good on that.

No, it was straightforward. It was very easy to implement and to have a load test.

Flexibility and speed to provision and start large (high concurrency) performance testing cycles.

This software solution has allowed us to run larger, high concurrency performance testing cycles in a very repetitive manner…a requirement for validating our application solutions and supporting infrastructure for customer facing web apps.

Out of the box reporting could be improved.

We have been using the solution for 9 months.

Some issues with UI but HP did provide high levels of support and the issue(s) were quickly fixed (within 3 days of initial product usage).

No issues with stability.

No issues with scalability.

Customer service was an 8/10.

Technical support 9/10.

Utilized a different HP toolset (ALM/PC) for performance testing. SRL provided a better solution from a pricing and scaling perspective.

Initial setup was straightforward…cloud based solution with a simple, flexible UI.

Vendor team…expertise (10).

Looked briefly at Neotys…actively doing a POC of CloudTest for comparison purposes.

You need to effectively plan anticipated usage of the toolset. This will enable you to purchase the appropriate amount of Vusers hours for your contractual period (in our case this was 12 months).

Its ability to work well with other HP products, particularly SiteScope, allows us to maintain consistency in our infrastructure. The different solutions work seamlessly together and free up resources that would otherwise be spent on conflicting vendors and products.

It's fast, easy to use, has a user-friendly UI, and you can split users. It also works well with SiteScope and other HP products.

It doesn't provide custom reports. You can only use the default reports which contain irrelevant data or is missing data that we need.

Also, a lot of our customers have issues logging into the cloud.

It's been stable.

It scales fine because our customers are usually larger.

Technical support is something we're not so happy with.

The initial setup is straightforward.

I can use it just as much as I need. It is quick and intuitive.

We are able to ensure very quickly and frequently that our product is ready for prime time. Using StormRunner, Codefresh has managed to identify performance issues and when these issues are introduced.

When you start a test, it takes times to initiate.

We have been using the solution for 7 months.

No issues with deployment.

No issues with stability.

We never encountered issues with scalability.

Excellent customer service.

Excellent technical support.

Very intuitive.

In-house technical people.

StormRunner does the job in a very simple and cost effective way. HP has always lead this market.