Tricentis NeoLoad Reviews

I worked for a real estate company and we used this solution to deal with scripting and anything related to documentation; uploading, downloading, etc. The product was built on .NET technology. We also used the product for mobile device performance testing. We had a few devices sitting on the Perfecto cloud, and we integrated those via NeoLoad API. NeoLoad has an integration framework in place for Perfecto so we were able to develop a few scripts, execute them and monitor the performance on a mobile device. I'm a senior test lead. 

The significant improvement to the company was in cost savings which is the main reason we migrated from LoadRunner. NeoLoad is about half the price. 

I have also worked on LoadRunner Micro Focus and JMeter, and when it comes to scripting, NeoLoad is more user-friendly. The capturing of dynamic variables is very simple in NeoLoad and doesn't require the writing of exclusive functions. It's a matter of drag and drop, or choosing an option. Scripting those applications is not a challenging process. NeoLoad is about half the price of JMeter and serves the same purpose. It also has the benefit of mobile integration frameworks which are already in place with the help of APIs. 

Many applications these days have dashboards, video images, and the like. The rendering of heavy-weighted applications can't be scripted via NeoLoad, so we have to use LoadRunner as an extra client. I think that component could be added to NeoLoad where the UI has more object rendering. For now, we cannot test that in NeoLoad and so people tend to go for the two client protocol of LoadRunner. For now, the GUA still sits on Windows so we do the scripting on our local machine and then transfer them to the cloud. It would be great if we could do everything on the cloud with NeoLoad. 

I used this product for two years. 

This is a stable solution that provides good performance. 

The solution is scalable. 

The customer service is good. We are based in India, and Tricentis also has an offshore team, so they're available in all time zones. I work on multi-vendor projects throughout the world. The company provides a flexible service and a fast response time. 

The installation was simple and was carried out in-house. We initially had some issues with crashing but that was related to Windows and not the product. At the time, I was working with a four-member team. 

We saw a good return on investment. In my tenure with NeoLoad over two years, I identified around 43 performance defects. That's a huge amount in a relatively short space of time. 

A couple of years ago, I paid around $USD9,000 per year for 250 users. The license fee includes web protocol, STTP protocol, and API. There might be an additional cost if you want Citrix, RDP or SAP.

This is a user-friendly and straightforward solution with a good support system. Unlike JMeter or LoadRunner, it doesn't require significant coding knowledge. 

I rate this solution eight out of 10. 

We use the product for performance and load testing.

It's user-friendly, and everything is handy, with scripting load testing and everything in a single tool. In LoadRunner, we have to use the controller for all those things.

The protocol support area could be improved.

I've been using the solution for almost a week.

From my experience, I would say the stability is good. I've heard about certain limitations, but I haven't experienced any yet.

The solution is scalable for up to 2,000 users, as far as I know.

The solution is easy to set up. I would rate it as eight out of 10 for ease of setting up.

I implemented it in-house on my own. It is open source. I downloaded it, and I was fine.

NeoLoad is expensive, but to my knowledge, it's better than LoadRunner. 

I don't have much experience with JMeter, so I don't know much about the differences between the products except that JMeter is open-source and NeoLoad is licenced, proprietary software.

On a scale of one to 10, I would rate Tricentis NeoLoad as seven. 

Tricentis NeoLoad was for a sports client of ours, and they had a web based application, and that application had a lot of APIs floating into a lot of sports applications. They were sports-based solutions, where you have people going to baseball sporting events, registering for the events, getting tickets, etc. That was the load that we tested with Tricentis NeoLoad.

The API side of Tricentis NeoLoad is good. The API support is much better with this solution, compared with the competition. Pricing for it is also more affordable than its competitor: Micro Focus LoadRunner.

There were some features that were lacking in Tricentis NeoLoad, e.g. those were more into Citrix and other complicated protocols, which were supported easily by a competitor: Micro Focus LoadRunner.

What we want to see in this solution is how it integrates with the entire suite of Tricentis Solutions. Tricentis has a very successful product in Tricentis Tosca, and that is a product that is more focused on test automation. They have test management solutions. They have different management. Performance management or performance engineering within one solution would be a big winner for Tricentis NeoLoad, so this is an area for improvement for this solution. Otherwise, it is a really good tool.

I still need to take a closer look at the integration of Tricentis NeoLoad. I want to see how it integrates with other Tricentis products, because Tricentis did not have a good performance testing tool until now. This is a recent acquisition, so we want to see how these results come together: test automation, performance testing, etc., so that's what I'm looking for.

Tricentis NeoLoad is absolutely stable.

We have used Tricentis NeoLoad and we find it scalable.

Tricentis acquired this product a year ago, so prior to that acquisition, the product was owned by an independent company, and their support was really good. We were supporting from India, and we had constant support from them. We never had any challenges with support for Tricentis NeoLoad.

We previously used Micro Focus LoadRunner, and switched to Tricentis NeoLoad because of the cost aspect, and we also found that Tricentis NeoLoad is also a good solution. It has very similar facilities like Micro Focus LoadRunner, but some of the features that are lacking there is more into Citrix and other complicated protocols, which Micro Focus LoadRunner easily supports. The API side of Tricentis NeoLoad was good, so we were able to do really good work with the solution. We bought it recently.

Compared to Micro Focus LoadRunner, the setup for Tricentis NeoLoad is easy.

Pricing is always cheaper with Tricentis NeoLoad versus the very expensive Micro Focus LoadRunner.

Pricing is really less compared to Micro Focus LoadRunner, but once this product goes under the Tricentis umbrella, we don't know how much are they charging for it now. I have not looked into the most recent pricing for Tricentis NeoLoad.

I have experience with performance testing tools, particularly Micro Focus LoadRunner, Apache JMeter, and Tricentis NeoLoad. We also did a POC with Tricentis Flood, but that is now gone. We also did some work with Microsoft, but they have started removing it. Even Microsoft provides a solution for performance testing: Visual Studio.

I'm rating Tricentis NeoLoad seven out of ten, while Micro Focus LoadRunner I'm rating a five out of ten. I'm not giving Tricentis NeoLoad a score of ten because I want to see more out of it in terms of integration, particularly how it integrates with other Tricentis products.

There is a customized version for BlazeMeter, but it's a solution that cannot be compared with either Micro Focus LoadRunner or Tricentis NeoLoad, because it is more of an open source solution, so you do not get support that's comparable with the support you get from paid solutions.

I am a senior performance engineer providing end-to-end performance testing. This involves gathering all non-functional requirements, creating a test plan, and creating a test strategy document. From there, we would start our benchmark and baseline testing based on the tool and protocol of the specific client in order to gather the scripting and the load testing. NeoLoad helps us identify bottlenecks and memory leaks which will help us increase the hardware capacity for the client and/or look at things on the software end including scalability, reliability, testing, and failure testing.

It offered us an easy to use, limited code option for end-to-end performance testing.

Each of the main components - design, runtime, and results - are unique in their own way.

The design offers four components: user part (which is where we would be creating and enhancing scripts while implementing things like pacing, think time, and error handling concepts), servers (which is where we have the service testing of API testing), population (which is where we can plug scripts, create multiple populations, and perform bandwidth testing), and monitors (which is a server-side where we can add credentials to a database or server via SSH details).

Runtime allows us to create scenarios, populations, low variation policies, load generators, and custom load profiles. Other functions include graphs, templates, check alerts, set alerts, check response time, etc.

The results tab provides us with the NeoLoad report which we can segregate.

We would like NeoLoad to be able to support more protocols.

Testing can also be a little tricky at times.

I have been using this tool for almost nine years.

This tool is easy to use. It requires little code implementation thanks to many predefined areas. I have not experienced any stability issues over the past nine years I have been using it.

I would rate the stability as five out of five. Right now we have about 500 users but in the past, we have had roughly 200k. They range from senior performance engineers to performance architects to performance test engineers.

Customer service is fantastic. I have been working with one customer service rep for the past nine years. 

Initial installation, registration, and setup were all straightforward and very easy, especially in comparison to other tools.

We were able to implement the tool with our in-house team.

We were able to set up per user basis licensing.

Newer additions such as NeoLoad SAP, Citrix, NeoLoad Web, etc. are excellent extensions with a broad range of new functions.

Organizations should be aware that there are limited videos available on the internet regarding NeoLoad so they should ensure that they receive proper training from the reseller/integrator upon purchase. 

The primary use case is for web applications and also SAP GUI—not SAP Applications but the UI version of SAP. For both these areas, it was working fine from the NeoLoad side.

The solution has been moved to the cloud version.

The first benefit is that it's quite cheaper. In the market there are mainly three tools which dominate: JMeter, LoadRunner, and NeoLoad. JMeter is open source. LoadRunner is quite expensive but has quite good features. NeoLoad is competitively quite cheaper compared to LoadRunner, and it provides great features, except in some areas. For instance, it doesn't allow some SAP applications. There are some areas where it's a little bit tough but other than that, it's quite good.

I feel that the codeless part, the dynamic value capture part is quite easy in NeoLoad compared to other tools. JMeter is a little bit tough, but LoadRunner gives you many features. For any codeless value, it is easy to detect from the NeoLoad side.

The SAP area could be improved. Not the GUI applications, SAP log-on, or something like that. We can see features and use NeoLoad properly in all the normal SAP log-on areas. I haven't tried it, but I have heard that Citrix-based applications don't work properly in the SAP application. In those types of different areas, there could be more protocol flexibility.

If there is a high number of users on NeoLoad—like around 5,000 or 6,000—it sometimes feels like that might be a bottleneck for the performance. That could be improved. With more users, there shouldn't be any issues from the tool side.

With scripting in a different browser, sometimes there are compatibility issues and it doesn't generate the script properly. Those types of crashes could be removed.

I was using NeoLoad six months ago because of some performance testing issues. Previous to using NeoLoad, we used LoadRunner.

The stability is good. It's quite reliable. Compared with a different browser, it sometimes creates problems and bugs. With the number of users increasing, sometimes the CPU and system where it was connected increases because of trade concurrency or something like that. That can be a little bit problematic. Other than that, things are fine.

Ongoing maintenance is not required. Whenever we have deployed the tools, if any version upgrade happens, we just check what the upgrade is exactly and someone on the deployment team connects the documents and everything. They check the document accordingly and update the version. It's not complicated.

We have roughly eight to nine performance testers, including the performance lead, the performance engineers, and the performance testers. Everyone will be running different projects. We'll be using the tool and running the performance testing based on the license and everything. The user count license will be ramping up the load. There are instances where multiple teams are using NeoLoad at the same time with different licenses. There has been no conflict error with each other, and we haven't seen a problem with different license things. Because we have two licenses, two tests can be executed parallel to each other.

The solution is scalable. After the number of users increases to 5,000 or 6,000, we have occasionally found problems. Below that, things are fine and the response times are good.

Tech support is okay. When we had 50 users, we reached out to the tech support team and within two to three days we received a response. The time took longer because it was a complicated problem. Response time is perfect.

I previously used LoadRunner. One of the reasons we had to switch to Neotys was because it was quite cheaper, but I still prefer LoadRunner to NeoLoad.

The deployment process is very straightforward. It's not complex. Only one associate deployed it, so not much effort was required.

There was no impact on the work that we used to do with performance testing when we moved to NeoLoad. Our normal performance testing was able to continue and it was going perfectly well. Return on investment was better because our deliverables were not getting impacted and it was cheaper, so return on investment increased a lot compared to LoadRunner.

NeoLoad is cheaper compared to other solutions. There are no additional licensing fees.

I would rate this solution 9 out of 10. I wouldn't give it a 10 because there are some issues that need to be resolved from the tool side.

Before using the tool, you need to understand the product you are going to design, the different types of performance applications that you are going to do performance testing with, and whether or not NeoLoad supports it. If yes, then go ahead. Otherwise, I would say go back to LoadRunner because whatever the application is, LoadRunner will support it.

In my company, we use the product on the cloud by just filling out and taking the subscription and then starting the application in our environment. In general, I am not aware of the technical areas associated with the product.

In Tricentis NeoLoad, there are some good options similar to what Apica offers. If you are planning extraction for eight or ten hours, NeoLoad can extract data from that particular time frame, which is something you can't do in Apica but is present as a good feature in Tricentis NeoLoad. With the tool, it is possible to compare NeoLoad test results against baseline and benchmark, and we can make the comparisons in the same window.

The debugging part of Tricentis NeoLoad takes time. Fixing the scripts takes time due to the problem with the debugging part. The debugging part of the product is an area that requires improvement.

I have been using Tricentis NeoLoad for a year.

My company uses the product on the cloud, so we have no issues with the tool.

At the moment, no one in my company uses the product. I used the tool when I worked with Vodafone's account, but at the moment, our company is not handling it anymore.

I have not contacted the support team of the product since I have not faced any issues with the solution.

The debugging part of Tricentis NeoLoad takes time. Fixing the scripts takes time due to the problem with the debugging part. The debugging part of the product is an area that requires improvement.

The solution is deployed on the cloud services managed by NeoLoad. Apache JMeter was also deployed on the cloud.

Not only for Tricentis NeoLoad but also any other tool would require some time to be installed.

Anyone can use the product, but it is important to create templates to focus on, especially if someone wants the business transactions to be easily captured in NeoLoad.

I rate the tool an eight out of ten.

One of our use cases, it was Oracle E-Business Suite (Oracle EBS) application testing. The other one was a migration project for SAP HANA. In those two use cases, we needed to perform benchmarking and increase the coverage from an end-to-end point of view rather than just focusing on the API endpoints. 

We had to automate some of the Oracle form-specific transactions using NeoLoad, as we wanted to expand the coverage. So, I used NeoLoad as a hybrid solution alongside JMeter. Initially, the majority of the volume was on JMeter, but for the Oracle forms usage, which was low, we utilized a low-volume license from NeoLoad.

NeoLoad is actually really good, mainly because they have a world-class support service.

NeoLoad can improve the correlation templates, which are specific to frameworks. There's room for improvement in that area.

In future releases, I think they definitely need a full UI revamp because I believe it's built on Java technology, which feels a bit outdated. I would like to see that being improved. Additionally, increasing the coverage of the correlation templates capabilities would be very useful.

I've used it across around three projects mainly because we provide the best options for our clients. We combine open-source tools with commercial ones. So, in two cases, we encountered limitations with JMeter, mainly because it doesn't offer off-the-shelf support for Oracle forms and SAP GUI. That's when we decided to introduce NeoLoad.

It is a stable solution. When I worked with this tool, the main pain point was finding solutions. They have some good documentation, but it could be improved because sometimes the feature I was looking for was already there, but it took me a while to find it due to the documentation. 

So, NeoLoad can improve the documentation. Otherwise, the tool itself is stable. For our purposes, using it with around 100 users, it was very stable.

It is a scalable solution. I have integrated NeoLoad three times in your personal projects. I would say the main feature that might lag for enterprise usage is the capability to manage scripts in a team environment. You should be able to maintain scripts across multiple users through a source code repository. I'm not sure whether NeoLoad fully supports managing Java programming-like stuff with ease through a source code repository. That might be one aspect that could make it more qualified for enterprise use. 

Other than that,  NeoLoad can support enterprise needs, but I'm not sure about the team environment support with a source code repository. But as for the tool itself, because we are using it at kind of an enterprise level, not extensively, but it caters to most of the requirements.

The customer service and support were good. The initial support I received from them was world-class. They treated the issues as their own, and I would rate it eleven out of ten. It was that good.

Positive

The initial setup is not that complex unless you try to use it against a complex application like Oracle Forms. Oracle always tries to encourage the use of its own proprietary performance testing tool. They make it harder for the clients to use other tools, pushing them to buy their own. That's when the complexity arises. Other than that, it's straightforward and very intuitive. 

As long as you have a basic understanding, it's not that hard to get started. Personally, I came from a JMeter open-source background, so transitioning to NeoLoad wasn't too hard for me.

Initially, we faced some configuration issues, and the documentation was a little lacking, but the support team was very helpful in resolving the problems and guiding me through the setup. After that, using the tool became a walk in the park. However,  NeoLoad can still improve certain aspects.

NeoLoad has a cloud solution, mainly for executing tasks, but the tool itself is an on-premises one. The main issue with these cloud providers is that they should come up with CNA, which is the security certification. Otherwise, people, especially in the government sector, don't want to use them. They are very conservative about security in New Zealand, so they prefer everything to be on-premises mostly. Cloud solutions, like Platform as a Service, are not easily embraced there; they prefer on-premises solutions. So, everything is on-premises.

NeoLoad now has a much more flexible licensing process. Earlier, it was hectic with people. Nowadays, licensing itself is a killer for most products.

For example, we purchased the Tableau license, and they had this on-premise licensing server setup, which is not working at all. So we had to ask them to give us a cloud license, and the discussion is still going on. They are trying to charge us additional stuff for Tableau. So our clients are now in a situation where they might abandon the product due to licensing issues, making it complex. People don't want to go through this. Really, it's easier to use the tool, but licensing itself takes a lot of unwanted complications.

So, with NeoLoad, we gave feedback and asked them to simplify the licensing model, and they came back with a better proposal.

If it weren't for the limitations in supporting Oracle forms and SAP GUI, I would never choose any other tool over JMeter. As for SAP GUI, we shouldn't fix anything unless it's broken, so I prefer sticking with JMeter. These commercial load test tools are insanely priced, especially the load test tools. 

That's why I appreciate that NeoLoad has come down with better, smaller licenses now. It's a good improvement. But I still think they are overpriced. This applies to all these tools, not just NeoLoad. If you look at them, they sometimes charge for virtual user hours, which I don't understand. When you buy a tool and a certain number of virtual users, you shouldn't be charged for hours of virtual use. Instead, you should be charged based on the number of virtual users, and the clients should be able to use it for the period they purchased the license.

Overall, I would rate the solution an eight out of ten. There are certain areas that need improvements in NeoLoad, like UI, correlation templates, and more.

This solution is mostly used by our customers to monitor the performance of the networks or of the server site.

We appreciate that this solution is very user-friendly, even if the user does not have a lot of protocol knowledge and experience.

We would like to see the addition of one-to-one integrations with the Tricentis Tosca suite to this product, which would then cover the end-to-end needs of our customers who are looking for a single vendor solution.

We have been working with this solution for 11 years.

We have found that the only stability issues, when using this solution, stem from the hardware in operation as opposed to the solution itself.

This is a fairly scalable solution.

We have found this solution to be very time saving for our customers, who report optimal resource usage since its implementation.

The licensing for this solution is renewable yearly, and covers all available features and technical support.

We would rate this solution a six out of ten.