We use this tool for load testing on web-browser based APIs.
Director, IT DevOps & Quality Engineering at a retailer with 10,001+ employees
Flexible to use and straightforward to implement
Pros and Cons
- "The most valuable feature is flexibility, as it connects to all of the endpoints that we need it to."
- "Most people focus on HTTPS or TCP, but it would be good to have support for a variety of different protocols."
What is our primary use case?
What is most valuable?
The most valuable feature is flexibility, as it connects to all of the endpoints that we need it to.
What needs improvement?
The price of this solution could be reduced to make it more competitive.
We would like to see more focus on support for other types of endpoints. Most people focus on HTTPS or TCP, but it would be good to have support for a variety of different protocols.
For how long have I used the solution?
We have been using NeoLoad for about six months.
Buyer's Guide
Tricentis NeoLoad
November 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
824,067 professionals have used our research since 2012.
What do I think about the stability of the solution?
We have experienced no issues in terms of stability.
What do I think about the scalability of the solution?
Scalability has not been a problem for what we use.
There are probably five users, including performance engineers and performance architects. It is only being used in one portfolio area right now, but we plan to expand our usage.
How are customer service and support?
I don't have any experience with technical support.
Which solution did I use previously and why did I switch?
We are currently using RadView WebLOAD in addition to Neotys NeoLoad. I am in the process of determining whether we should standardize on one tool, and choosing the one that makes the most sense, or continue to use both of them.
The reason we started working with NeoLoad is that it was a carryover from another site that I was working on. I was looking to see if there was an opportunity.
The subscription pricing of NeoLoad is higher than RadView WebLOAD.
How was the initial setup?
The initial setup is straightforward. Integration with our environment was seamless.
Maintenance is minimal and can be done with one person.
What's my experience with pricing, setup cost, and licensing?
Licensing for NeoLoad is subscription-based.
What other advice do I have?
My advice to anybody who is implementing NeoLoad is to first understand the technical requirements. Also, it is important to make sure that you have access to the endpoints that you want to load-test on.
Overall, it seems like a good product.
I would rate this solution an eight out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Programmer Analyst at a tech services company with 10,001+ employees
Everything is handy, with scripting load testing, but the protocol support area could be improved
Pros and Cons
- "I would rate it as eight out of 10 for ease of setting up."
- "The protocol support area could be improved."
What is our primary use case?
We use the product for performance and load testing.
What is most valuable?
It's user-friendly, and everything is handy, with scripting load testing and everything in a single tool. In LoadRunner, we have to use the controller for all those things.
What needs improvement?
The protocol support area could be improved.
For how long have I used the solution?
I've been using the solution for almost a week.
What do I think about the stability of the solution?
From my experience, I would say the stability is good. I've heard about certain limitations, but I haven't experienced any yet.
What do I think about the scalability of the solution?
The solution is scalable for up to 2,000 users, as far as I know.
How was the initial setup?
The solution is easy to set up. I would rate it as eight out of 10 for ease of setting up.
What about the implementation team?
I implemented it in-house on my own. It is open source. I downloaded it, and I was fine.
What's my experience with pricing, setup cost, and licensing?
NeoLoad is expensive, but to my knowledge, it's better than LoadRunner.
What other advice do I have?
I don't have much experience with JMeter, so I don't know much about the differences between the products except that JMeter is open-source and NeoLoad is licenced, proprietary software.
On a scale of one to 10, I would rate Tricentis NeoLoad as seven.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Tricentis NeoLoad
November 2024
Learn what your peers think about Tricentis NeoLoad. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
824,067 professionals have used our research since 2012.
Test Specialist at a financial services firm with 10,001+ employees
Improves the test lifecycle time, but the GUI component isn't stable enough
Pros and Cons
- "The Frameworks feature is valuable. NeoLoad Web and the API are also valuable. It provides API support."
- "The overall stability of the GUI should be improved. The GUI component is not stable enough. We have observed crashes several times."
What is our primary use case?
We are using it for performance testing.
How has it helped my organization?
It's improving our test lifecycle time. It's taking less time compared to the previous tool.
What is most valuable?
The Frameworks feature is valuable. NeoLoad Web and the API are also valuable. It provides API support.
What needs improvement?
The overall stability of the GUI should be improved. The GUI component is not stable enough. We have observed crashes several times.
There should also be support for more protocols for desktop applications.
For how long have I used the solution?
I have been using this solution since 2019. It has been four years.
What do I think about the stability of the solution?
I'd rate it a four out of ten in terms of stability. The GUI isn't stable enough.
What do I think about the scalability of the solution?
I'd rate it a seven out of ten in terms of scalability.
Within our team, we have around 25 users. Their roles are testers, test leads, and test managers.
We aren't planning to increase its usage. The way we are using NeoLoad and other tools is pretty streamlined. We are using NeoLoad 90% as per our requirements, and we aren't planning to increase its usage.
How are customer service and support?
I'd rate their support a four out of ten. The problem is that we have to raise a support ticket in the portal. They usually take a long time to reply. The first or second response from the team usually covers the basic tasks, which the team would have already done before reaching out to their support team. So, by the time we get a proper response from them, we might have moved away from that particular project or we might have found some alternative. That part is a bit bad.
How would you rate customer service and support?
Neutral
Which solution did I use previously and why did I switch?
We were using Micro Focus LoadRunner. We switched because of the organization's requirements.
How was the initial setup?
As compared to other tools, the initial setup is easy, but there is some complexity that comes with the Kubernetes-based setup of one of the components. So, it's a bit easier than others, but there are certain aspects that make it difficult. I'd rate it a six out of ten in terms of the ease of the setup.
Its deployment took a couple of weeks, which also included testing.
What about the implementation team?
It was deployed in-house. We deployed it ourselves based on the documentation.
For deployment, we only need one employee who has experience in cloud deployment. For maintenance also, one admin is enough.
What's my experience with pricing, setup cost, and licensing?
I'd rate it a seven out of ten in terms of pricing.
Which other solutions did I evaluate?
We evaluated open-source tools such as Scala and JMeter. We went for NeoLoad because of the collaboration feature, which isn't there in Scala and JMeter. Another reason was the enterprise support, which doesn't come with open-source tools.
What other advice do I have?
It's definitely worth a try. Compared to LoadRunner and other tools, it gives more flexibility and is easier to maintain.
Overall, I'd rate Tricentis NeoLoad a seven out of ten.
Which deployment model are you using for this solution?
Hybrid Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Technology Manager at a pharma/biotech company with 10,001+ employees
We like the native mobile application testing. I would like to see it support SAP GUI based applications.
What is most valuable?
- Flexible license model
- Cloud integration
- Native mobile application testing
How has it helped my organization?
I had a requirement to test a mobile application for corporate that is used by users across the globe. I needed to do the test setup quickly to generate load across the region, and to do so with a solution that was cheaper than what we had. A NeoLoad license of four days with load generation from the cloud across regions helped to do the setup in three to four days and perform the testing.
What needs improvement?
It needs to support SAP GUI-based applications, which forms 60-70% of our portfolio, as well as Windows (client install) and Citrix-based applications.
For how long have I used the solution?
I've used it for two years.
What was my experience with deployment of the solution?
We had no issues deploying it.
What do I think about the stability of the solution?
There have been no stability issues.
What do I think about the scalability of the solution?
We tested up to 1,000 users across four regions - North America, EMEA Latin America, and Asia-Pacific. It scaled sufficiently for us to be able to do that cross-regional testing.
How are customer service and technical support?
It's excellent as the support is always available and helps us to troubleshoot any issues during execution with live support.
Which solution did I use previously and why did I switch?
We were using HP Performance Center in-house for the previous six years. NeoLoad was tried as there was a need to test mobile applications with load generated from the cloud.
How was the initial setup?
The initial setup is straightforward for both an in-house and a cloud one.
What about the implementation team?
The implementation was done by an in-house team.
What's my experience with pricing, setup cost, and licensing?
The licensing model is very flexible which supports a broad range of budgets, from small projects to enterprise-level setups.
What other advice do I have?
Choose this if your portfolio is predominantly web and mobile. You need to reconsider if your portfolio has many SAP GUI-based applications.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Manager Business Solutions
A good, user-friendly performance monitoring tool, but lacking in cross-product integration functionality
Pros and Cons
- "We appreciate that this solution is very user-friendly, even if the user does not have a lot of protocol knowledge and experience."
- "We would like to see the addition of one-to-one integrations with the Tricentis Tosca suite to this product, which would then cover the end-to-end needs of our customers who are looking for a single vendor solution."
What is our primary use case?
This solution is mostly used by our customers to monitor the performance of the networks or of the server site.
What is most valuable?
We appreciate that this solution is very user-friendly, even if the user does not have a lot of protocol knowledge and experience.
What needs improvement?
We would like to see the addition of one-to-one integrations with the Tricentis Tosca suite to this product, which would then cover the end-to-end needs of our customers who are looking for a single vendor solution.
For how long have I used the solution?
We have been working with this solution for 11 years.
What do I think about the stability of the solution?
We have found that the only stability issues, when using this solution, stem from the hardware in operation as opposed to the solution itself.
What do I think about the scalability of the solution?
This is a fairly scalable solution.
What was our ROI?
We have found this solution to be very time saving for our customers, who report optimal resource usage since its implementation.
What's my experience with pricing, setup cost, and licensing?
The licensing for this solution is renewable yearly, and covers all available features and technical support.
What other advice do I have?
We would rate this solution a six out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
Head of Systems Engineering & Operations at Ipoque - a Rohde & Schwarz company
It offers better reporting than most competing tools
Pros and Cons
- "NeoLoad offers better reporting than most competing tools. It is effortless to analyze and measure the reported data. It's also simple to generate a report that most people can read and management can understand. NeoLoad helps you figure out the main issues inside the application."
- "Some users may find NeoLoad too technical, while other users may prefer a scripting language instead of a UI with figures and forms they have to fill in."
What is our primary use case?
We are primarily testing APIs but also testing the UI in some cases. In my last job, I also developed a plugin to enable NeoLoad to measure the end-user experience. If you have a modern web application, you usually only exchange JSON files between the client and the server. On the client side, you will render the JSON information to an HTML side or a dynamic DOM structure.
NeoLoad is used for testing the response time, which is not the same as the time it takes for the user to see the page. When the JSON document arrives on the client side, the client has to render the information. If you are considering the user experience from the end user's perspective, you are not interested in how long it takes to get the JSON. You want to know how long it will take to get the JSON and see the information on the page.
NeoLoad can't do this because it does not render the data from the server. The browser engine uses considerable RAM, so we cannot simulate many users simultaneously. We enabled NeoLoad to control a typical test. For example, a QF Test like Robot Framework tests the web UI. It starts and renders the application to measure how long it takes to see some special information on the page.
These response times are fed into NeoLoad through a data exchange API, enabling us to visualize the actual user experience inside NeoLoad. That's NeoLoad's primary advantage. It has incredible APIs to implement special additional features or plugins you need for special applications.
How has it helped my organization?
NeoLoad helped us to transition from load testing to continuous performance measurement. It is integrated into our CI/CD pipeline. We implemented performance testing like you would have unit or functional tests. Every day, we get information if something happens in our application that affects the performance in a negative way.
What is most valuable?
NeoLoad offers better reporting than most competing tools. It is effortless to analyze and measure the reported data. It's also simple to generate a report that most people can read and management can understand. NeoLoad helps you figure out the main issues inside the application.
What needs improvement?
Some users may find NeoLoad too technical, while other users may prefer a scripting language instead of a UI with figures and forms they have to fill in.
For how long have I used the solution?
I began using NeoLoad when Neotys still owned the product. In total, I have about 13 years of experience working with the solution.
How was the initial setup?
Setting up NeoLoad is straightforward.
What about the implementation team?
We deployed NeoLoad in-house. I already had experience with the solution from my previous job, so we didn't need Tricentis to send a consultant to help us. However, it's helpful to take advantage of their consultants if you need them. Tricentis has a network of freelancers, so it's easy to find a consultant near you, and you can usually find somebody who speaks your mother tongue.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Offers excellent support and the pricing is reasonable but it has a few glitches
Pros and Cons
- "The stability is okay."
- "LoadRunner offers a full protocol, whereas, with this product, only a few of the protocols are supported - not all."
What is most valuable?
The support is very good. They have excellent community support.
The pricing is pretty good.
The stability is okay.
What needs improvement?
There are still some glitches that they need to improve. We have given support feedback as well when we have some issues. They're very responsive and they do work to fix and improve issues.
LoadRunner offers a full protocol, whereas, with this product, only a few of the protocols are supported - not all.
For how long have I used the solution?
I've used the solution for five years.
What do I think about the stability of the solution?
We do occasionally deal with glitches. The previous versions are very stable. The newer versions have some glitches and sometimes it hangs, however, for the most part, it's okay.
There are issues around some protocol settings, like when we use encryption. When a person uses the banking application, the user and password are encrypted. We have issues with the encryption protocol. Lately, some settings may have changed and it seems to be working.
What do I think about the scalability of the solution?
While it's a good solution, I cannot speak to the scalability.
How are customer service and support?
The community support is good. Whenever we have an issue, they provide support to resolve it. If we need information about features, they help. Support is very good.
Which solution did I use previously and why did I switch?
We use the solution as projects demand. We are a consulting company. Whatever the client has already purchased, we will use that. We work with all kinds of tools.
What was our ROI?
I don't have any details related to ROI.
What's my experience with pricing, setup cost, and licensing?
I'm not exactly sure what the pricing is as it differs from client to client.
That said, LoadRunner is expensive and NeoLoad is less expensive whereas JMeter is free.
Which other solutions did I evaluate?
I'm familiar, for example, with LoadRunner. When you compare this with Load Runner, Load Runner is the best tool as it, number one, is very user-friendly when compared with the NeoLoad. It also supports the protocols. It is very mature, so people are very comfortable with it. The monitoring is good, and it has a lot of good features.
NeoLoad will not support all the protocols and it's not as user-friendly as LoadRunner. I use LoadRunner more than NeoLoad, and therefore am more comfortable with it.
I also am familiar with JMeter, which is an open-source option and therefore a free tool. In comparison, NeoLoad is a big tool and JMeter is quite small. With NeoLoad, you can get all kinds of reports, flexible reports and you can customize the reports as well. We can drill down on the reports if we want. That's not possible in JMeter.
What other advice do I have?
NeoLoad is a good tool for banking or telecom applications. When compared with the LoadRunner, NeoLoad will support almost all necessary features including reporting. It is a good tool.
Overall, I would rate the solution at a six out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Helps with POC-level activity
Pros and Cons
- "I like the solution’s performance and integration. Also, the tool’s help center is very responsive and helpful. They have always helped me within a short duration of time."
- "The solution’s pricing is higher compared to other tools. Though the product’s reports are accurate, it needs to be more detailed like other tools."
What is our primary use case?
We use the tool to do POC level activity.
What is most valuable?
I like the solution’s performance and integration. Also, the tool’s help center is very responsive and helpful. They have always helped me within a short duration of time.
What needs improvement?
The solution’s pricing is higher compared to other tools. Though the product’s reports are accurate, it needs to be more detailed like other tools.
For how long have I used the solution?
I have been working with the solution for six months.
How was the initial setup?
The tool’s setup is straightforward. The installation takes a couple of hours to complete.
What other advice do I have?
I would rate the solution an eight-point five out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros
sharing their opinions.
Updated: November 2024
Popular Comparisons
Apache JMeter
Perfecto
OpenText LoadRunner Professional
BlazeMeter
OpenText LoadRunner Cloud
OpenText LoadRunner Enterprise
ReadyAPI
Oracle Application Testing Suite
Eggplant Performance
RadView WebLOAD
Akamai CloudTest
SmartBear LoadNinja
ReadyAPI Performance
StresStimulus
Buyer's Guide
Download our free Tricentis NeoLoad Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- Experiences with NeoLoad on Mac OSX?
- Do you recommend Tricentis NeoLoad?
- When evaluating Load Testing Tools, what aspect do you think is the most important to look for?
- SOAtest vs. SoapUI NG Pro?
- Does Compuware have a manual testing solution? Which manual testing solutions should we be considering?
- What are the top performance tools available to load test web applications?
- What is the best tool for mobile native performance testing on real devices?
- When evaluating Performance Testing Tools, what aspect do you think is the most important to look for?
- Cost of TOSCA Testsuite?
- Do you have an RFP template for Testing Tools which you can share?