OpenText LoadRunner Professional Reviews

What we like the most is that it integrates with UC. We use UC for our front-end user experience. It's a more realistic user experience. 

We use the script from the user experience and we use the action times from the UC.

If they were able to, I would say that the scalability could be improved. If the costs were not as expensive to upgrade, then we would scale it more.

The initial setup could be simplified.

I would like to see better licensing costs. 

I have been working with this solution for ten years.

It's a stable solution. In the ten years that we have been using it, I have only had an issue once.  We had an issue with the protocol where it didn't support the job. We contacted support.

It's a scalable solution but I think that the Enterprise version is more scalable and more manageable.

It's fine for us, as we only have a few projects a year. On a larger scale, Enterprise would be better than the Professional edition.

When I had contacted technical support they very helpful.

Previous versions were easy to install but we struggled with the LoadRunner Enterprise to get it to work. It was a bit challenging.

LoadRunner Professional is an expensive product.

I like using LoadRunner and I recommend it.

I would rate this solution an eight out of ten.

In our organization, the solution is required for the testing of the performance of applications, response time, and the utilization of resources.

Initially, if you wanted to produce the load from different locations, you needed to have a physical machine there. But with time, the new features ensure that you can (if you want to) have one machine in the Pacific and one in North America. You can request and you can test those machines. You can connect and you can create loads from those locations. It's a very good feature. It's made things easier for us.

The most useful aspect of the solution is that it provides agents in different geographic locations. 

The controller is the best feature, in my opinion.

The solution is very costly. The cost is very high, especially considering a lot of other resources are available now and they are less expensive. For a small organization, it is very difficult to sustain the costs involved in having the solution or the related fees.

The technical support aspect of the solution could be improved.

Their current dashboard and their reporting is still following the earlier waterfall models. If they can add some things in the reporting, and update it so it is more modern, that would be great.

I've been using the solution for five years. My organization continues to use it.

This is a really stable tool. We haven't had issues with bugs or glitches. It hasn't crashed on us. We've been satisfied with the level of stability it provides.

The solution is quite scalable. We've run tests with 20,000-30,000 users with no problem. You can add as much as you want, depending on the kind of license you hold. There may be certain licenses that offer limitations. However, with the right license, there sholdn't be issues with regard to scaling.

We don't plan on scaling further ourselves. The plan for the future, right now, is to reduce the usage and include some freeware tools to supplement our needs. 

The technical support is not as great as we expected them to be. The one or two times we have connected with them, they referred us to a model. They often say they will get back to us instead of helping us immediately. It's not very good.

The last issue we had was related to some specific application. The tool was not able to identify the objects on the screen. We had questions, as they used some technology tool provider, and said they were testing at that time, and had mixed the technology on that screen, on the GUI. Loadrunner was not able to recognize it. They said they would come back to us, but we have not seen any answer from them since then. That was around a year back. We've had many questions since then as well.

In the end, we had to solve it internally, but there is no solution from the tool company. Maybe in the next release it will be resolved.

I don't recall looking at other options. We simply decided to go with Loadrunner from the beginning.

The initial setup of the solution was very straightforward, as I recall. It wasn't too complex.

The cloud has allowed for deployments to happen fairly fast. You need one URL and within 15-20 minutes you can have it installed on your local machine.

Due to the fact that the solution has a pretty straightforward initial setup, we didn't need outside assistance. We didn't require the help of integrators or consultants. We handled everything in-house.

In terms of ROI, LoadRunner does everything. Web-based applications or free applications have a poor ROI in comparison. You just don't get the same quality.

I don't have any information about how much it costs to run the solution. I know it is expensive, but I don't handle the accounting, so I'm unsure how much our organization actually pays. I don't believe there are other costs beyond the standard licensing fee.

There are different licence tiers. We have the maximum, so so don't have to deal with any limitations at any time.

There's two types of users on the solution. One is the actual testers. In our organization, we have twenty people using this load. The others are virtual users. The licensing is dependent upon the virtual user and you are charged according to how many virtual users are using the application. Around twenty users are virtual in my organization.

At the time we started with Loadrunner, it was the leader in the market. Now, of course, we have options. However, back then we did not have any competitors to look at or compare to.

We're partners with OpenText.

I'd advise other organizations, if cost is not a problem, to consider LoadRunner, as it is the best product on the market. However, it's not cost-effective for a small company. It's much more suited for enterprises. Smaller companies should look at other options. 

It's a good solution within the market, but it is costly in this region. It is very high. For some it might not make sense when the cost is so high and the support is somewhat lacking.

From an ease of use, installation, deployment, and multi-use tool perspective, I'd rank the solution definitely at an eight or nine out of ten. However, once you include the cost, I'd reduce the ranking to seven out of ten.

All of our installations are on-premises at the moment.  

One of the most valuable features to me is that LoadRunner is familiar. I have worked with it for so long that I know where everything is and I know how it is supposed to work.  

But focusing on actual program features, all I can say is it has good protocol coverage.  

I have not had a really good look at the newest versions of LoadRunner. The problem I have always had with LoadRunner — and even more so with Performance Center — is that it is not very good with agile delivery and it is very difficult to integrate. Software engineers who have been working in agile delivery have been saying this for some time, and have been having success with alternatives.

Also, Performance Center has historically been quite unreliable and difficult. It tends to fail at collation. I think that is because of the Load Runner architecture that Performance Center inherited. Everything waits until the end of a test to collate and it does not always work out well. I know that Micro Focus has done something about that in the new version. But that is the worst thing that happens: with LoadRunner or Performance Center you run a big critical test and you can't get the results.  

I have personally been using LoadRunner and Performance Center for 20 years. I think it's been the backbone of performance testing for 20+ years and must be given credit for helping establish the discipline.

Stability has been an issue. It has really been a big problem for us with Performance Center in particular. Crashing or exiting during collation is not acceptable.   

We have not been totally satisfied with the scalability. We tend to have more issues with Performance Center. The more you try to grow use with it on-prem, the more headaches you have. Often working with LoadRunner and smaller environments is more reliable. We believe the SaaS solution might be better because you have got centralized management.  

Most of my experience is in the early days of Mercury, they were brilliant. They were really good and helped resolve issues. I have not been using them recently.  

Right now we use LoadRunner and Performance Center depending on what we believe are best practices for different situations. We are considering evaluating other options as well, including LoadRunner SaaS.

The two Micro Focus products are interesting to compare. LoadRunner is very easy to set up. Performance Center needs an expert. I can install LoadRunner in minutes by myself. To do the installation properly with Performance Center needs a specialist and takes weeks.  

Plenty of people seem to have installed Performance Center in a couple of days, but when they use it they usually have problems. You really need to do it properly. I do plan to have a look at the newer versions, and maybe those implementations will be smoother.  

Advice that I would give people considering LoadRunner is that I would recommend exploring other tools first or at least in comparison. There are lots of really good open-source or even just cheaper alternatives. Depending on your use case, the other options might be much better. LoadRunner has broad protocol coverage. Sometimes you have got no choice but to go with a solution because of what it can do. But I think the days of LoadRunner being the only solution out there for this kind of testing have gone. There are some very good competitors now and where the competitor can do the job, you will save money.  

On the scale from one to ten where one is the worst and ten is the best, I would rate Micro Focus LoadRunner Professional as about a six. I have not taken a good look at the latest version, but my current experience with the version of the product we use has not been great.  

The primary use is for load testing and stress testing of applications. It tests whether services are running at an optimal point or not. It can also be used for benchmarking with other industry standards.

My admin was very useful for finding out how the system responds to load, stress, and normal situations, as well as benchmarking with other industry competitors. It also improved our response time, memory delegation, and CPU delegation. In addition, we used LoadRunner to optimize our database and website.

The features that are most valuable are synchronization capabilities and the ability to interact with it on different types of systems and protocols. It is a market leader and it integrates with different applications. When you compare it to JMeter, LoadRunner is more flexible and has more capabilities than JMeter to support different technologies.

There is room for improvement of the pilot processing and forwarding results based on the dump analysis. We have a generator, root controller, different agents, and an analyzer, so all of these are very important when it comes to LoadRunner.

LoadRunner also has to create a low-cost version that supports simpler testing and only some of the simple features would be included. This would allow people to use LoadRunner and get support from LoadRunner in terms of application testing. It is a principle that if people will get to use LoadRunner for free, LoadRunner will get more business and major payback.

I would rate it 6 out of 10, because LoadRunner is a vast thing, starting from those scenarios and then getting more into users, putting more points, correlation, load testing, and benchmarking. I have this part and hope it works well with the system. All of this is very complex. It takes a long time to learn the system well.

The stability of the solution is mostly good. The only thing is that we used a distributor to fix the problems when something went wrong at one point. If it was working out well, the results of that thing would still give you wrong results. So the distributor is not really good with problems, but the local setup is good with no problems.

We can scale it up at any point in time because we can get a distributor. We can add variants, controllers, claims, and analyzers, so it will support different types of protocols.

We just created load scenarios and we will load the scenarios to a number of virtual users. For example, we can load around 1,000 users for each scenario. In abnormal conditions, we could have 10,000 users. Also, loading them depends upon the role alias and role controller's configuration.

The size of staff required for deployment and maintenance depends upon what application and how many load scenarios you want to do, as well as the complexity of your application, how much hardware you have, and how much software support you have. All of those things will come into the picture.

They would be different types of users like a read-only user, a write-only user, etc.

We use JMeter and LoadRunner together: When we're stress testing and for service or load testing we use JMeter, while we use LoadRunner for basic load testing. We keep it like that but we can see how that mitigation works and the application is also for internal users, so we consider what it does there and we can do a lot of those things.

We are not actually concerned with the technical support of the LoadRunner. We get support for the LoadRunner through the internet.

We previously used JMeter.

The initial setup is not that difficult. When it comes to distribution systems then it will be somewhat difficult, and you need to have a proper network to work on. Another consideration is that at the distribution level and onward we need to put different controllers, unions, and claims at different locations to have a product as accurate as this.

The deployment took some time because we needed to know what type of load is expected in the future and what the break-even point would be, at which point of load. We needed to know the different scenarios that were expected and plan the load testing and the load batterings and always stick to the plan. We needed load analysis, a load plan, and benchmarking standards. All of these need to be collected. This equipment needs to be connected before we can actually begin testing.

The deployment takes around one month man days based on the application status.

We used a consultant for deployment.

We did some return on investment analysis, by using the POC (proof of concept). We compared other tools with LoadRunner, JMeter, and LoadRunner and we got a generated a scenario testing based on the place of publication and we determined that LoadRunner is good.

I don't know the licensing cost, but I think that you would get a discount for normal usage. I think there are different yearly options for different types of usage. It is not only how many users, but also whether it is shareable or not and other criteria involved in each feature. There are additional fees for the users and hardware linked to the processing.

We evaluated JMeter and LoadRunner together to form the selection process. For some scenarios we can use LoadRunner for specification road testing, while for other types of testing we prefer JMeter.

When you compare other products to LoadRunner, LoadRunner has been in the market for a long time. You could use it to integrate with everything. Also, it can generate an input that we can use in any version, it can improve our performance, and we can put input in and we get a command from LoadRunner for that.

Based on the requirements, we use Micro Focus LoadRunner Professional. Our clients have their licenses and access. So, we execute in the client environment itself, which involves, basically, running a load test or stress test using the tool and analyzing the system performance with different metrics like server session and clientset.

Micro Focus LoadRunner Professional improved our organization's functioning. However, the cost is very high, and the support system is very low. If you ask for one ticket, like, you create a case, and they'll come back in one week of time. Then, they keep asking for most of the access to the environment, which is, like, the client's environment, and we can't provide access to the support. So there are a lot of challenges with those things. Upgrading to the new versions has a lot of challenges. The tool, access, and features they are building meet industry standards and are very helpful.

When you speak about its integration capabilities, especially when we talk about the latest version and not the older version that we had integrated with Dynatrace. So, we are integrating the current version with a tensor database and Grafana dashboards. So we can directly communicate it. The current version also integrates with DataDot, where whatever execution is there, we can collate results in DataDot itself and analyze the server-side metrics with that time duration so that everything is in one single place.

The kind of protocols that the current version supports is good since it's improved when compared to Version 12.55. I am very much happy with the tool and its process. The cost and the support lakhs a lot.

The support and price are the downsides of the solution. Micro Focus should decrease the cost. So, I'll explain one scenario. So, I work for multiple different clients to whom I provide support on the subject matter. Regarding the cost, if you consider 20,000 virtual user hours, if a user uses it for ten minutes, one virtual user is down. And if a user uses, like, 100 users for ten minutes, 100 virtual user hours are gone. So, instead of 100 multiplied by ten, it should be the number of minutes that get converted into hours, and that is the number of virtual hours that should be gone. In pay-per-use, the cost is more, and the unlimited license, like, an unlimited number of executions, costs even more. And mobile solutions, like earlier, could be integrated with the mobile center. Now mobile centers are very costly. So, doing it per device and testing has become challenging. I need to depend on other tools where I need to convert those scripts to LoadRunner and then run the test on this tool. So I need to pay two different software techs for licenses to solve mobile performance testing. In short, if that is done within that system, it could be helpful for us.

The licensing system is not very convenient for me. I would like to increase the number of working hours per license. Also, performance testing on mobile devices could be better.

Performance testing on mobile devices requires external software. You have many tools, and you have other tools which support on-device performance testing. So that tools can be integrated with LoadRunner. But, then the cost becomes high. So, if LoadRunner has some specific specialty, like, any on-device testing would be of a single user. If I connect my USB to a laptop and execute the test on a device, and test the application using the number of, like, one user running it for a certain duration of time, then it would be helpful for me to calculate the response time as well as the well device-level metrics like CPU memory or battery consumption. Right now, LoadRunner is lacking in the aforementioned areas.

Testing your kind of WebRTC protocols, like if you have a streaming application, and I want to join 5,000 concurrent user sessions. So, it is a one-session ID for 5,000 users joining that video session, and there is a tutor who is, like, teaching the lessons to the students. So this is a scenario. It's a kind of video conversation. I just want to analyze the number of users, the user behavior, video quality, audio quality, and how many users get dropped from the call. I think the latest version for 2023 doesn't support a few particular things causing lagging issues. It has an MQTT protocol, and executing a test on the Kafka messaging queue, I don't think we need to write a custom Java code and then we need to build those Java JAR files or load agents, and then, normally, we can run it. So there is a dependency. So there are a lot of Java JAR files we need to substitute and run. So instead of that, if LoadRunner itself has that entire tool set installed in their location, and if you can just plug and play the request, it would be good. If you go to Apache JMeter, it's simple, so if you go for ActiveMQ, I give the configuration details and then give a custom message. It is a simple step where I can execute and push thousands to ten thousands of messages to the queue. But in LoadRunner, it is a complex thing.

It's been three years since we tried to migrate from Micro Focus LoadRunner Professional Version 12.55 to LoadRunner Enterprise 2023, but there is no active support from the team. We did not deploy because of a lack of support. We need a license bundle if all things are to be migrated. We have one TB of data that needs to be migrated to the new system.

For maintenance, I think one person is required, and sometimes to update, like, if you do hundreds of activations and browse the tools, which overall has a slowness in general. So maintaining and creating tables and all those stuff requires

support, and I think one resource is required. The person should preferably be an administrator, and he should be aware of the database, repository file system, networking, and all such stuff.

I have been using Micro Focus LoadRunner Professional for ten years. I am an end-user of the solution. I am using Micro Focus LoadRunner Professional Version 12.55, and sometimes for some projects, we use Micro Focus LoadRunner Enterprise 2022.

Stability-wise, I rate the solution a nine out of ten.

Scalability-wise, I rate the solution a nine out of ten. Scalability is good. I can generate the number of user loads while adding a number of cloud instances and execute them anytime. I didn't see any issues with the tool while trying to scale at a large level.

Around 10 to 15 performance engineers are using the solution in my company. Also, the solution is used daily, and I mostly use it in the client environment.

So, it's currently used at its maximum rate.

On a scale of one to ten, where one is low, and ten is high-quality technical support, I rate the support a one.

Negative

Previously, we were using HP. Though the tool's functionalities remain the same, its ownership keeps getting changed. We go with multiple open-source solutions like JMeter and all.

I rate the initial setup a seven or eight on a scale of one to ten, where one is difficult and ten is easy. Considering my impressions of the product, I understand that it is a commercial tool, and it is very stable and of good quality. In general, it is very good. But, there are multiple factors where we can reject it because of its cost, support, and considering that anything that is very new can be done in the open-source tool. So rather than this particular thing, we need Micro Focus to put in extra effort. So, green screen applications are not supported by the solution. Also, ActiveMQ won't be supported in the solution. So for that, I need to write a custom code. I need to build different Java JAR files. Then, it doesn't support Java 64-bit, which is very poor. It supports only Java 32-bit version. For ActiveMQ and Kafka messaging queues, Java 64-bit is more dependable. So, that is completely redundant.

In the organization part, we have it deployed on-prem. But most of the tool licensing that we use is on the client side itself since the client purchases the tool, and so in their environment, we do the test.

On a scale of one to ten, where one is low and ten is a high price, I rate the solution a five. So, many things can be done with open-source solutions rather than Micro Focus LoadRunner Professional. But LoadRunner provides scalability and stability, which helps save the money of our customers.

If you have enough money, then you can go ahead with the solution.

Overall, I rate the solution an eight out of ten.

Our primary use case of this solution is to do testing for banks and financial institutions. 

At the moment I like to use the TruClient port, add them and create other versions of TruClient, because TruClient is usually too big to handle heavy loads, so you need to recreate a vamp version for whatever you will need. 

Sometimes I have problems when I want to record a script if the application is a little special, like the login part. I think the TruClient works well and they are developing new things there all the time. So it's getting better. I would like to see an easier way to move things from SoapUI to the same addressed services and postman or something like that. Because the developers will use the other products and then the website and then load them at no cost. So if it was just one step to move from one system to another it would be a great improvement.

The solution is quite stable. I've seen a few bugs of course - they will always be there. That's not a big deal and I just work around it. 

I guess scalability becomes a problem when you use things like TruClients. It eats lots of memory, so usually, I have two or three low generators while I have the one controller. We have had some problems with when we are using a BPM system. In the beginning, it was quite difficult when we changed to this other system and we wanted to connect to the home computer. 

We have about 12 users, mostly testers, working on the solution currently. Then we have two people working in our performance center. 

The technical support is good. Whenever we had a problem, they solved it. 

The initial setup was quite straightforward and it's quite easy to install the standard version. Everything takes less than an hour.

My advice to others would be to look into the application differently. In the next version, I would like to see an easier way to create and use TruClient for development and to move it to another version. They already have this function, but it is not very user-friendly. You cannot do a correlation of things now, because it is on a higher level now. So you have to do a lot of work. 

My rating for this solution is nine out of ten. I've used it a lot, so I guess it's possible to make things better, but it's been around for a while, so I think it's very good.

For me as a user, the flexibility in different protocols and things like that which can be tested with the tool.

We're able to test standalone from individual machines.

The stability on the old versions is good. On the newer versions, the bleeding edge is still being worked on.

It's very scalable. No issues with scalability.

Premium support is great, but before that when we just had general support, it was not all that great. We had issues with trying to get support to call us back on tickets and turnaround time on resolution.

It's not exactly straightforward. Their instructions were not all they could have been, but we still got it installed.

It is very strong in providing load testing solutions. It provides a lot of protocol support and its reporting utility is very good. Also, the virtual user generation, controllers, and analyses are good.

It helped our organization to run successful performance testing cycles and to identify the bottlenecks of the application. It helped the clients run their application successfully and smoothly.

We would like to be able to implement the tool in such a way that load testing can also be done in the cloud.

We've used it for four years.

There was an issue that I faced with different versions of the controller and Performance Center. They should have been of the same version.

I didn't have many stability issues. The tool is very stable as you just need to check what protocols you want to test.

No issues encountered.

Customer support is good, and the turnaround time for requests is very fast. Also, they have created a forum where experts will help you without creating a ticket.

8/10

I used JMeter and Oracle Application Testing Suite as well, but according to our client’s wish we went for this solution.

It is straightforward. You just have to go through the read-me document and installation guide provided along with the software.

We did it in-house.

I would say it is true value for the money.

The license cost is much more compared to other tools available, but it will give you a complete package for load testing your application.

I evaluated JMeter and Oracle Application Testing Suite, but this proved better than those.

If you are looking for customer satisfaction, you can simply go and get it.