Try our new research platform with insights from 80,000+ expert users
Dirk O. Schweier - PeerSpot reviewer
Head of Systems Engineering & Operations at Ipoque - a Rohde & Schwarz company
Real User
It offers better reporting than most competing tools
Pros and Cons
  • "NeoLoad offers better reporting than most competing tools. It is effortless to analyze and measure the reported data. It's also simple to generate a report that most people can read and management can understand. NeoLoad helps you figure out the main issues inside the application."
  • "Some users may find NeoLoad too technical, while other users may prefer a scripting language instead of a UI with figures and forms they have to fill in."

What is our primary use case?

We are primarily testing APIs but also testing the UI in some cases. In my last job, I also developed a plugin to enable NeoLoad to measure the end-user experience. If you have a modern web application, you usually only exchange JSON files between the client and the server. On the client side, you will render the JSON information to an HTML side or a dynamic DOM structure.

NeoLoad is used for testing the response time, which is not the same as the time it takes for the user to see the page. When the JSON document arrives on the client side, the client has to render the information. If you are considering the user experience from the end user's perspective, you are not interested in how long it takes to get the JSON. You want to know how long it will take to get the JSON and see the information on the page.

NeoLoad can't do this because it does not render the data from the server. The browser engine uses considerable RAM, so we cannot simulate many users simultaneously. We enabled NeoLoad to control a typical test. For example, a QF Test like Robot Framework tests the web UI. It starts and renders the application to measure how long it takes to see some special information on the page. 

These response times are fed into NeoLoad through a data exchange API, enabling us to visualize the actual user experience inside NeoLoad. That's NeoLoad's primary advantage. It has incredible APIs to implement special additional features or plugins you need for special applications.

How has it helped my organization?

NeoLoad helped us to transition from load testing to continuous performance measurement. It is integrated into our CI/CD pipeline. We implemented performance testing like you would have unit or functional tests. Every day, we get information if something happens in our application that affects the performance in a negative way.

What is most valuable?

NeoLoad offers better reporting than most competing tools. It is effortless to analyze and measure the reported data. It's also simple to generate a report that most people can read and management can understand. NeoLoad helps you figure out the main issues inside the application. 

What needs improvement?

Some users may find NeoLoad too technical, while other users may prefer a scripting language instead of a UI with figures and forms they have to fill in.

Buyer's Guide
Tricentis NeoLoad
December 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
831,265 professionals have used our research since 2012.

For how long have I used the solution?

I began using NeoLoad when Neotys still owned the product. In total, I have about 13 years of experience working with the solution. 

How was the initial setup?

Setting up NeoLoad is straightforward.

What about the implementation team?

We deployed NeoLoad in-house. I already had experience with the solution from my previous job, so we didn't need Tricentis to send a consultant to help us. However, it's helpful to take advantage of their consultants if you need them. Tricentis has a network of freelancers, so it's easy to find a consultant near you, and you can usually find somebody who speaks your mother tongue.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Associate at Tech Mahindra Limited
Real User
Offers excellent support and the pricing is reasonable but it has a few glitches
Pros and Cons
  • "The stability is okay."
  • "LoadRunner offers a full protocol, whereas, with this product, only a few of the protocols are supported - not all."

What is most valuable?

The support is very good. They have excellent community support.

The pricing is pretty good.

The stability is okay. 

What needs improvement?

There are still some glitches that they need to improve. We have given support feedback as well when we have some issues. They're very responsive and they do work to fix and improve issues. 

LoadRunner offers a full protocol, whereas, with this product, only a few of the protocols are supported - not all.

For how long have I used the solution?

I've used the solution for five years.

What do I think about the stability of the solution?

We do occasionally deal with glitches. The previous versions are very stable. The newer versions have some glitches and sometimes it hangs, however, for the most part, it's okay.

There are issues around some protocol settings, like when we use encryption. When a person uses the banking application, the user and password are encrypted. We have issues with the encryption protocol. Lately, some settings may have changed and it seems to be working.

What do I think about the scalability of the solution?

While it's a good solution, I cannot speak to the scalability.

How are customer service and support?

The community support is good. Whenever we have an issue, they provide support to resolve it. If we need information about features, they help. Support is very good.

Which solution did I use previously and why did I switch?

We use the solution as projects demand. We are a consulting company. Whatever the client has already purchased, we will use that. We work with all kinds of tools.

What was our ROI?

I don't have any details related to ROI.

What's my experience with pricing, setup cost, and licensing?

I'm not exactly sure what the pricing is as it differs from client to client.

That said, LoadRunner is expensive and NeoLoad is less expensive whereas JMeter is free.

Which other solutions did I evaluate?

I'm familiar, for example, with LoadRunner. When you compare this with Load Runner, Load Runner is the best tool as it, number one, is very user-friendly when compared with the NeoLoad. It also supports the protocols. It is very mature, so people are very comfortable with it. The monitoring is good, and it has a lot of good features.

NeoLoad will not support all the protocols and it's not as user-friendly as LoadRunner. I use LoadRunner more than NeoLoad, and therefore am more comfortable with it.

I also am familiar with JMeter, which is an open-source option and therefore a free tool. In comparison, NeoLoad is a big tool and JMeter is quite small. With NeoLoad, you can get all kinds of reports, flexible reports and you can customize the reports as well. We can drill down on the reports if we want. That's not possible in JMeter.

What other advice do I have?

NeoLoad is a good tool for banking or telecom applications. When compared with the LoadRunner, NeoLoad will support almost all necessary features including reporting. It is a good tool.

Overall, I would rate the solution at a six out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Tricentis NeoLoad
December 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
831,265 professionals have used our research since 2012.
PeerSpot user
Senior Performance Engineer at Ascend Learning
Real User
Best tool for testing in production without making many changes to the script or solution
Pros and Cons
  • "It helped in achieving the testing of on-premise applications, as well as cloud-based applications, without much difficulty."
  • "NeoLoad is best tool for testing in production without making many changes to the script or solution."
  • "NeoLoad does not support Citrix-based applications."

What is our primary use case?

Used for performance testing of applications on QA environments as well as production environments. NeoLoad is best tool for testing in production without making many changes to the script or solution.

How has it helped my organization?

It helped in achieving the testing of on-premise applications, as well as cloud-based applications, without much difficulty.

What is most valuable?

  • Integration of all components in one place.
  • GUI-based requests
  • Ease of use compared with other performance tools.

What needs improvement?

NeoLoad does not support Citrix-based applications. Neotys should take a look into this protocol.

For how long have I used the solution?

One to three years.

What do I think about the stability of the solution?

No issues.

What do I think about the scalability of the solution?

No issues. As far as Neotys NeoLoad, it is excellent in scalability.

How are customer service and technical support?

The support is good. 

Which solution did I use previously and why did I switch?

We started with NeoLoad.

How was the initial setup?

The initial setup is easy.

What about the implementation team?

The implementation was done in-house.

What was our ROI?

Our ROI is 100%.

What's my experience with pricing, setup cost, and licensing?

The licensing cost is less compared to other licensing performance testing tools.

Which other solutions did I evaluate?

We tried JMeter, but due to its support (which we found subpar), we had to switch to NeoLoad.

What other advice do I have?

You will love NeoLoad moving from open source and code-based performance tools.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Load Test Engineer at a government with 10,001+ employees
Consultant
All-in-one product with load generators deployed globally.

What is most valuable?

All-in-one product (design, runtime, results), easy scripting and variable correlation, and load generators deployed all around the world to simulate global traffic.

How has it helped my organization?

It is easier to do load tests using NeoLoad.

What needs improvement?

The only improvement that I wanted is support for load tests in agile mode. Neoload 5.2 makes this possible by updating the old versions of scripts with data from the new HTTP requests.

For how long have I used the solution?

I have 4 years of experience.

What was my experience with deployment of the solution?

The only issue that I had was with network virtualization on load generators installed on Windows Server 2008 R2. The link is sometimes cut between the controller and the load generators.

How are customer service and technical support?

10/10. Support is available, they handle issues very quickly, and they are very skillful.

Which solution did I use previously and why did I switch?

I used HPE LoadRunner. I think that NeoLoad is more user-friendly.

How was the initial setup?

NeoLoad is easy to deploy using the install wizard.

What about the implementation team?

Well, first I got trained by a vendor team. After that, I implemented more projects using NeoLoad.

My advice is that there should be a minimum of 4GB of memory on the servers on which you are installing NeoLoad.

What's my experience with pricing, setup cost, and licensing?

Neotys provides a free evaluation licence to use NeoLoad with up to 50 virtual users and all protocols included.

The product licence remains cheaper than HP LoadRunner, for example.

Disclosure: My company has a business relationship with this vendor other than being a customer: We are a partner of Neotys. We do consulting for them.
PeerSpot user
it_user356646 - PeerSpot reviewer
Senior Manager Online Performance Engineering at Dell
Vendor
It took just a few minutes to set up Neotys Cloud, as opposed to a few days with other solutions. We also want to monitor applications within various environments, which NeoSense will soon allow.

Valuable Features

It is convenient to be able to keep up the pace in which the application code was delivered to us. Since we manage nearly 500-600 applications and we need to make sure they are tested, we wanted something robust with an option to check against previous baselines with minimal human intervention without sacrificing criteria.

We wanted something with less risk when incorporating or shifting scripts.

The fact that it loads from an external cloud is a plus as well.

It took just a few minutes to set up Neotys Cloud, as opposed to a few days with other solutions.

Room for Improvement

They are coming out soon with NeoSense. It's a hybrid between app management tools and a testing tool. This will be helpful for us because we'll be able to monitor applications within various different environments. This is precisely what we have wanted.

Use of Solution

We've been using it for a year.

Deployment Issues

We had no issues with deployment.

Scalability Issues

We used to have only 50 online users. Later we moved to where we are.

Customer Service and Technical Support

We have used their gold support option. Yes, we have been happy. They usually answer between 36 and 48 hours for non-critical issues, and with critical issues they hold your hand.

Implementation Team

We did it in-house.

Pricing, Setup Cost and Licensing

We didn't negotiate the price. To give perspective, we went from spending three million dollars to 160 thousand dollars, which is a huge saving and good value.

Other Solutions Considered

One of our goals was to find a platform that would have the functionalities that we were used to while incorporating in other ones. ProLoad was a competitor, and one other (can't make out name).

We wanted it to support agile and devops, while being able to upgrade to a number of releases over the course of a day, so it was a fit.

Other Advice

The company really strives on experience, always making sure that I as a customer am happy. For example, my team at Dell had an issue with our new version, which we had just updated to. Another team used a different version which required different protocols, and there were discrepancies between the versions. The company found out that our errors were user errors, and helped us fix the problem.

I helped them in terms of product development since we at Dell told them requirements and they added that to product life cycles. So we are a customer, but told them some requirements we'd like to see.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Ujwal Gaikwad - PeerSpot reviewer
Associate Software Engineer at Nts automation labs pvt ltd
Real User
Top 10
An easy-to-use solution that can be used for performance testing purposes, like load testing and stress testing
Pros and Cons
  • "Tricentis NeoLoad is quite easy to use as compared to JMeter."
  • "Tricentis NeoLoad crashes if an application contains more than 1,000 scripts."

What is our primary use case?

We use Tricentis NeoLoad for performance testing purposes, like load testing and stress testing.

What is most valuable?

Tricentis NeoLoad is quite easy to use as compared to JMeter. The other valuable features of Tricentis NeoLoad include correlation, parameterization, load testing, and file parsing.

What needs improvement?

Tricentis NeoLoad crashes if an application contains more than 1,000 scripts. Tricentis needs to improve in this area, and the solution should run smoothly even if thousands of scripts are imported into it.

For how long have I used the solution?

I have been using Tricentis NeoLoad for one and a half years.

What do I think about the stability of the solution?

I rate Tricentis NeoLoad a nine out of ten for stability.

What do I think about the scalability of the solution?

Around 10 to 12 users are using Tricentis NeoLoad in our organization.

I rate Tricentis NeoLoad an eight out of ten for scalability.

How was the initial setup?

The solution’s initial setup was easy.

What about the implementation team?

Tricentis NeoLoad can be installed in ten minutes.

What's my experience with pricing, setup cost, and licensing?

Tricentis NeoLoad is not an expensive solution, but it can be quite expensive if we need a license for load testing, depending on the organization level.

On a scale from one to ten, where one is expensive, and ten is cheap, I rate Tricentis NeoLoad's pricing a seven out of ten.

What other advice do I have?

I would recommend Tricentis NeoLoad to other users.

Overall, I rate Tricentis NeoLoad a nine out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1609227 - PeerSpot reviewer
Vice President - Global Head of Delivery at a computer software company with 201-500 employees
Real User
Allows users to place agents on multiple geographic locations, has no issues with stability, and scales up fast
Pros and Cons
  • "My company has a good experience with Tricentis NeoLoad, and what I like best about it is that it lets you generate loads from different geographies. The load generation agents getting placed on different geographies is a very good feature of the solution. I also like that you can scale up Tricentis NeoLoad very quickly. The general feedback on performance testing with Tricentis NeoLoad for all product lines within my company is good."
  • "An area for improvement in Tricentis NeoLoad is its price, as it has a hefty price tag."

What is our primary use case?

We use Tricentis NeoLoad for performance testing across our product lines.

What is most valuable?

My company has a good experience with Tricentis NeoLoad, and what I like best about it is that it lets you generate loads from different geographies. The load generation agents getting placed on different geographies is a very good feature of the solution.

I also like that you can scale up Tricentis NeoLoad very quickly.

The general feedback on performance testing with Tricentis NeoLoad for all product lines within my company is good.

What needs improvement?

An area for improvement in Tricentis NeoLoad is its price, as it has a hefty price tag.

For how long have I used the solution?

We've been using Tricentis NeoLoad for about three years.

What do I think about the stability of the solution?

Tricentis NeoLoad is a stable solution, and my company didn't have any problems with its stability.

What do I think about the scalability of the solution?

Tricentis NeoLoad is a scalable solution. It tests performance, so it has to be scalable.

How are customer service and support?

Technical support for Tricentis NeoLoad is good. My company hasn't had many issues with support. If I were to rate support from one to five, my rating would be four out of five.

How was the initial setup?

Tricentis NeoLoad is a solution that's easy to set up. Deploying it wouldn't take much time, as deployment could be completed within just a few days.

What's my experience with pricing, setup cost, and licensing?

Pricing for Tricentis NeoLoad could be cheaper because, at the moment, it's expensive. For a year, the solution cost us a lot of money, in particular, more than $50,000.

What other advice do I have?

I'm using the latest version of Tricentis NeoLoad.

In my company, two people from the performance testing department use Tricentis NeoLoad.

My rating for Tricentis NeoLoad is eight out of ten.

My advice to others looking to start using Tricentis NeoLoad is that it's a good product, and it would be money well spent.

My company is into product development, and it's a user or a customer of Tricentis NeoLoad.

Which deployment model are you using for this solution?

Private Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user380010 - PeerSpot reviewer
Senior Load Test Engineer at a tech vendor with 501-1,000 employees
Vendor
several key features: Jenkins integration, infrastructure monitoring, and results analysis.
Pros and Cons
  • "There are several key features, including Jenkins integration, infrastructure monitoring, and results analysis."
  • "It needs improvements in the UI. It's currently not as friendly as it should be."

What is most valuable?

There are several key features, including Jenkins integration, infrastructure monitoring, and results analysis.

How has it helped my organization?

Implementing this product has allowed us to increase the number of projects that get load testing, and the frequency by which we re-test our performance.

What needs improvement?

It needs improvements in the UI. It's currently not as friendly as it should be.

For how long have I used the solution?

We've used it for seven years.

What was my experience with deployment of the solution?

We haven't had any issues with deployment.

What do I think about the stability of the solution?

We have never experienced any isuses with stability.

What do I think about the scalability of the solution?

The product has scaled very well up until this point.

How are customer service and technical support?

The support from Neotys is very good. Responses are timely and come from experienced, knowledgeable load testing professionals.

Which solution did I use previously and why did I switch?

We previously, and still use JMeter for some projects, in addition to Neoload.

How was the initial setup?

The initial setup is straightforward for basic usage. The setup for higher volume load testing is more involved, but I wouldn't say complex, as should be expected for an enterprise class load testing tool.

What about the implementation team?

We implemented it with our in-house team.

What's my experience with pricing, setup cost, and licensing?

It's priced based on the numbers of VUs, virtual users, that your needs require. The free edition gives you 50 VUs. The pricing is fair for high-volume licensing. Cloud VUs can be rented on-demand for bursts of higher capacity testing needs without permanent purchase.

Which other solutions did I evaluate?

We looked at JMeter and Webload.

What other advice do I have?

I highly recommend understanding load testing concepts before using any automation tool.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user200979 - PeerSpot reviewer
it_user200979Owner and Managing Director at a tech services company with 51-200 employees
Real User

I basically agree with this review. The 'Other Advice' is one of the most valuable parts. Whatever you are using, you need to understand what you are doing. A representative load test environment and sufficient coverage of the application being tested are often ignored, producing test results that will not predict the performance of your production environment.

Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros sharing their opinions.
Updated: December 2024
Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros sharing their opinions.