Try our new research platform with insights from 80,000+ expert users
it_user671397 - PeerSpot reviewer
Test manager at a financial services firm with 10,001+ employees
Vendor
We can configure browser settings for different operating systems and on different versions without the need to install every version on each machine.
Pros and Cons
  • "The most valuable feature is the ability to configure browser settings for different operating systems and on different versions without the need to install every single version on each machine and to manage them."
  • "I'd like to see more ability to dive more deeply into the configuration."

What is most valuable?

The most valuable feature is the ability to configure browser settings for different operating systems and on different versions without the need to install every single version on each machine and to manage them. This is the most useful feature that I'm interested in.

I'm also interested in mobile center services related to StormRunner functions because we are going to determine which will be the best solution for developing mobile testing. And we are interested in outsourcing mobile testing, so this kind of environment will be useful as we are not engaged in the configuration of infrastructure. Also, I think it will be useful because Storm Runner functionality does not need specific configuration because the configuration basis is in the UFT and the UFT can be in our environment. We do a lot of configuration because we develop a custom framework related to UFT. So, I appreciate that configuration can be managed by us, while the browser can be released on the remit version.

What needs improvement?

I'd like to see more ability to dive more deeply into the configuration.

What do I think about the stability of the solution?

I think the product is still immature because we have some problem reaching the mobile center connection related to a proper configuration on our machine. In fact, we are in touch with the R&D team to fix the configuration for our environment. I also think that it will be useful to have an object recognition tool because the specific configuration on the browsers are to be managed so as to fix our specific test. I need to recognize what was the configuration on the remit browser and I need a tool to analyze the impact of the browser configuration on the test.

What do I think about the scalability of the solution?

I think the scalability is fine with this kind of solution because I have no problem with how many machines will be available to run the test; it's a matter of the cloud provisioning. It will be useful to run the tests in multiple environments in parallel. That will be a good tool for us when we have to make tests with a shortage of time.

Buyer's Guide
OpenText LoadRunner Cloud
November 2024
Learn what your peers think about OpenText LoadRunner Cloud. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
816,406 professionals have used our research since 2012.

How are customer service and support?

I have not used technical support recently. HPE support is always prompt to solve the issues. That is the main thing I appreciate regarding support.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user426591 - PeerSpot reviewer
Lead Performance Architect at a tech company with 1,001-5,000 employees
Vendor
Scripts developed in JMeter can be uploaded instead of spending time creating new ones. It needs to be configured with SiteScope or AppDynamics.

What is most valuable?

JMeter script integration. This integration feature is a good approach provided by HPE. Sometimes, we need to run scripts developed in an open source tool like JMeter. Instead of spending time on creating new scripts, the scripts developed in JMeter can be uploaded and based on the protocol license because it is a DEV user protocol, it provides a valuable feature when integrated with StormRunner.

What needs improvement?

Monitoring and sample access to servers needs to be provided, so that we can explore this and keep up-to-date.

The licensed version / free edition needs to be configured with SiteScope or AppDynamics, which many customers might not have. The LoadRunner feature of Windows Resource Monitor should come in handy in such scenarios. It is not only for Windows-based monitoring but also for UNIX-based monitoring. Dependency on the other tools or HP tools (SiteScope) would be reduced.

It needs to be more mature.

The client breakdown is a separate report and is not part of the existing load test report. The client breakdown is basically the response time observed from different browsers. We need to take a snapshot and place it in the load test report and that is not available when the load test report is generated from StormRunner.

Also, for the VuGen Web protocol, it supports only 12.50 and above, which is tough and compatibility is lost.

For how long have I used the solution?

More than a year and half

What was my experience with deployment of the solution?

I did not encounter any issues during deployment, but there are not enough tutorials available for the TruClient protocol and also on the reporting side.

What do I think about the stability of the solution?

I have worked extensively on the various module supported by STRL2.1v and provided my suggestions/improvements/recommendation to the HP R&D Team

How is customer service and technical support?

Customer Service:

Good

Technical Support:

The level of customer service / technical support is satisfactory, with a few times good.

For example, when trying to learn the monitoring feature of StormRunner, I requested access to the Web Tours application that is installed on the server so I could explore that feature in depth. However, access was denied (monitoring-only access was provided). My question was: When both the application and the tool belong to HPE, why was access denied?

What other advice do I have?

The end user needs to have strong skills in any of the load testing tools, specifically if they already have experience with LoadRunner.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
OpenText LoadRunner Cloud
November 2024
Learn what your peers think about OpenText LoadRunner Cloud. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
816,406 professionals have used our research since 2012.
it_user468132 - PeerSpot reviewer
Consultant/Partner at a tech consulting company with 501-1,000 employees
Consultant
Virtual user hours is much more dynamic than virtual user days or static licenses.

What is most valuable?

It's the license and structure because it's so dynamic. Virtual user hours is much more dynamic than virtual user days, and even more dynamic than static licenses. I did a test a short time ago where we could keep the test to half an hour so we could really optimize this virtual user hour. That was wonderful.

How has it helped my organization?

It's used to improve our customers, but we don't use it in-house.

What needs improvement?

I'm a consultant and this was used for a small project. My customer bought around five consulting days from me. We ran into some undocumented limits around the number of concurrent users. It was really just set up to keep the guys out that wanted to do denial of service using the demo account. It was not clear that this was the limit it would hit. That's expensive for a company. Out of five days, maybe half a day. That's 20% of the budget went into trying to run a test. The test fails, contact support, ask what's going on. Make them move the limit and then re-run. That was bad. It should just be upfront - these limits exists, be sure before you start that you don't want to move them.

What do I think about the stability of the solution?

Quite good.

What do I think about the scalability of the solution?

I trust it. I haven't tried it with thousands of virtual users. As true client, yes of course. We had arl 6000 true client users. That's 60 gigabyte memory. It's not a PC, so it's not large.

How are customer service and technical support?

Quite responsive.

Which solution did I use previously and why did I switch?

We were previously using LoadRunner for our customer, but we needed something that could be used in the cloud. I advised the customer to buy StormRunner Load as given the time frame it was clear from the beginning that we needed to use the true client scripts. We didn't want to set up the memory foot print for them so we had to go to cloud.

How was the initial setup?

It was difficult because the Amazon stuff didn't work. I don't like to use Microsoft stuff. I was forced to put it onto Azure Cloud because that was the one that just worked out of the box. The Amazon launching died somewhere in the process. There was another error there as well.

Which other solutions did I evaluate?

I'm an HPE partner. I don't look anywhere else.

What other advice do I have?

For all the in house stuff where we run into firewalls, it just gets bad. For public websites, it's perfect.

The flexibility makes it a viable solution.

Disclosure: My company has a business relationship with this vendor other than being a customer: We're partners,
PeerSpot user
it_user251874 - PeerSpot reviewer
Performance Analyst at a educational organization with 1,001-5,000 employees
Vendor
StormRunner is one of the fastest-growing cloud based performance testing tools for running high concurrency tests very quickly.

What is most valuable?

  • Load generator setup is not required so we can be running high concurrency tests in few minutes.
  • Scenario setup for running tests was very easy.
  • Distribution of the load from different locations was very easy.
  • SiteScope and New Relic monitoring tools can be easily integrated with StormRunner Load.
  • SLA configuration was available to monitor response times.
  • Navigation breakdown report - to create a client navigation breakdown report.
  • Real time graphs for monitoring results.
  • Email reports.
  • Benchmark- comparing previous test results with current tests.
  • Anomalies detection.

How has it helped my organization?

Being able to setup and run 300,000 load tests using LoadRunner Performance Center takes around 1 to 2 hours when creating four scenarios of 75,000 each, including allocating/blocking load generators required for testing, initializing the fusers and running the test.

Running a 300,000 test was very easy using StormRunner. We just had to upload the script and create scenarios for 300,000 and run the test in 20 minutes.

Running back to back high concurrency test was very easy using StormRunner.

What needs improvement?

  • Improved PDF reports and creating custom reports
  • Real world- custom scenario setup
  • Update existing scripts online without uploading them again
  • Run time settings update in scenario

For how long have I used the solution?

I've used it for five months.

What was my experience with deployment of the solution?

None - there's no deployment required for running a load test.

What do I think about the stability of the solution?

During the initial days of high concurrency testing (300,000 and 600,000) we had issues with the StormRunner infrastructure e.g. graphs “disappeared” in the middle of a test, and HP had to give an online fix. Also, there were cases where tests appeared as “initializing” even though it actually started and HP again had to give an online fix. The StormRunner R&D team was very proactive in fixing the issues in very small turnaround time and supporting us running the high concurrency tests.

What do I think about the scalability of the solution?

Scalability issues were seen during initial days of testing but it was resolved by StormRunner R&D team.

How are customer service and technical support?

Customer Service:

8/10.

Technical Support:

8/10 - their team was very proactive in resolving the issues and provided hotfixes to support us running performance tests whenever required.

Which solution did I use previously and why did I switch?

We were using Performance Center to run performance tests, so we had to switch to StormRunner to run high concurrency tests.

How was the initial setup?

As StormRunner Load is a web-based application, it's simple setup, just registering users through an HP site.

What about the implementation team?

In-house implementation and evaluation.

Which other solutions did I evaluate?

There were no other solutions evaluated.

What other advice do I have?

StormRunner is one of the fastest-growing cloud based performance testing tools for running high concurrency tests very quickly.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user567969 - PeerSpot reviewer
Test Architect at a engineering company with 1,001-5,000 employees
Vendor
It's easy to set up a load test, to start it and end it. It needs a lot more LoadRunner Analysis features.

What is most valuable?

It's in the cloud. Everything goes in the cloud. We needed something that's easy to set up in the cloud so we can use it directly there.

It's very easy to set up a load test, to start it and end it. It is valuable that it is very easy to use.

How has it helped my organization?

We are not benefitting a lot at this time because it has its bad parts.

What needs improvement?

It needs more features; a lot more features. Everything that's in LoadRunner Analysis should be built up in StormRunner; so we can use everything, every functionality and every feature all together.

What do I think about the stability of the solution?

It's stable. It's not perfect, but it's stable.

What do I think about the scalability of the solution?

It is not really scalable.

How is customer service and technical support?

We didn't use it that much. It was a demo session set up especially for us.

How was the initial setup?

It's very east to set up. I did it directly myself just once.

Which other solutions did I evaluate?

We compared it to LoadRunner and Performance Center because we use that currently for load and performance tests. We cannot use this solution in the cloud. StormRunner is very rudimentary at this time, but it's a great concept. We hope that it will be thrilling.

We chose StormRunner because of the cloud. That's a great part of it.

What other advice do I have?

Wait with StormRunner.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user469167 - PeerSpot reviewer
Solution Architect at a tech company with 501-1,000 employees
Vendor
We use it for spike testing before an application goes into production or before a big event.

Valuable Features

We've seen in the past where we have customers that use other performance testing products such as LoadRunner and Performance Center that they often have the need to do spike testing. Their testing for 1,000 virtual users running at the same time but before the application goes into production or before a big event, they need to scale up to 10,000, 20,000, 50,000, and so forth. We want to make sure that they can test to those specific limits and StormRunner allows us to do that.

Room for Improvement

I think the biggest issues that I've seen, and this is a personal view of mine, is that most of the HPE products have a common look and feel to them. I'd really like to see it be a little more customizable to a use and user standpoint. For example. I happen to be colors blind, so I'd like to see more vivid colors on the UI, and things like that. It would make it a little more flexible from the customer standpoint.

Use of Solution

I was formally an HP employee, so I've used the HP products in the past. I also was a former Mercury Interactive employee which was acquired by HP.

Scalability Issues

It's been extremely scalable as far as the testing that we've done with our customers. They've all been really satisfied with the scalability of the HPE products.

Customer Service and Technical Support

We've gone through the standard customer support and it’s been good. It's not quite to the level that an R&D would be, because they really get really under the covers to fix things.

Other Advice

It really doesn't need to be as flexible as some other solutions because it's right out of the box, it's relatively easy to use. You open up, you create a test in ten minutes and then you're able to run it.

Disclosure: My company has a business relationship with this vendor other than being a customer: We're partners.
PeerSpot user
it_user675813 - PeerSpot reviewer
it_user675813Sr.System Engineer(Performance Engineering) at a insurance company with 10,001+ employees
Vendor

is there any work around for transactional grouping and Ip spoofing?

See all 2 comments
it_user232020 - PeerSpot reviewer
Senior Test Analyst with 1,001-5,000 employees
Vendor
Valuable features include the fact that you don't have to worry about the infrastructure setup.

What is most valuable?

  • The fact that you don't have to worry about the infrastructure setup.
  • The fact that 1000's of virtual users can log on to the cloud without having to set up.
  • Provides a solution for new or existing customers.
  • Alternative to LoadRunner, for new or existing clients with agile.

What needs improvement?

At the moment, its a bit early for us to tell - does everything we need it to. HP is looking to expand to see what exactly it can be used for.

For how long have I used the solution?

We did a trial since it was launched.

What was my experience with deployment of the solution?

No issues with deployment.

What do I think about the stability of the solution?

No issues with stability.

What do I think about the scalability of the solution?

We were only running a small set of numbers, but no issues.

How are customer service and technical support?

Customer Service:

It's not something we've really had to worry about - we were able to crack it open and begin.

Technical Support:

The help files on the web are good and the video links/ guides are good.

Which solution did I use previously and why did I switch?

We use LoadRunner extensively for Performance testing.

How was the initial setup?

Setup was straightforward.

What about the implementation team?

In-house implementation.

What was our ROI?

I can't calculate the ROI right now but I would assume a lot considering savings on infrastructure cost and license costs. It will still take some time to run a performance test but setup saves a lot of time.

Which other solutions did I evaluate?

We evaluate a lot of testing tools. NeoLoad, LoadRunner, we prefer HP.

What other advice do I have?

If you're looking at an application that can be seen on the WAN and using agile approach, then its a tool that should be recommended and used.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
PeerSpot user
Performance Test Architect and HP ALM Expert at a tech services company with 10,001+ employees
Consultant
I have been able to run several tests from outside the corporate LAN which in the past used to be an infrastructure nightmare.

What is most valuable?

  • Ability to get started on the fly
  • Reusability of existing HTTP/HTML scripts

How has it helped my organization?

I have been able to run several tests from outside the corporate LAN, which in the past used to be an infrastructure nightmare as it required opening up ports, disabling firewalls, etc.

What needs improvement?

It needs the ability to execute other protocols, especially the TruClient for Firefox without having to convert them.

For how long have I used the solution?

We've used it for over a year.

What was my experience with deployment of the solution?

There have been no issues with the deployment.

What do I think about the stability of the solution?

We have had no stability issues.

What do I think about the scalability of the solution?

It's scaled to our needs.

How are customer service and technical support?

Customer Service:

Customer Service is immaculate.

Technical Support:

Tech Support is immaculate.

Which solution did I use previously and why did I switch?

There was no solution in place previously.

How was the initial setup?

There was no set-up required.

What about the implementation team?

It's done in-house, but there's no actual implementation needed.

What's my experience with pricing, setup cost, and licensing?

There pricing and licensing options are very aggressive, but the holiday discount brought down the price further.

What other advice do I have?

I think that StormRunner Load is the way forward and if HPE manages to support all protocols currently supported by LoadRunner/Performance Center eventually in StormRunner, it would be a massive game changer.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user334491 - PeerSpot reviewer
it_user334491Sr. Software Test Engineer at a financial services firm with 5,001-10,000 employees
Real User

How can we use StormRunner for company's internal network applications, which can't be accessed by outside users?

See all 2 comments
Buyer's Guide
Download our free OpenText LoadRunner Cloud Report and get advice and tips from experienced pros sharing their opinions.
Updated: November 2024
Buyer's Guide
Download our free OpenText LoadRunner Cloud Report and get advice and tips from experienced pros sharing their opinions.