Try our new research platform with insights from 80,000+ expert users
it_user602877 - PeerSpot reviewer
Senior Performance Engineer/ Staff Qa Member at a tech vendor with 51-200 employees
Vendor
It can generate a heavy load and provide a report that shows how the system behaved under the load.

What is most valuable?

Ability to generate heavy load (up to 5000 concurrent users)

Provide performance transactions summary & statistics

These features are valuable because, in my company, there is a requirement for the product to support up to 5000 concurrent users. As a performance engineer, it’s important to have a tool (like BlazeMeter) to generate heavy load and at the same time provide a report that shows how the system behaved under the load and provide performance statistics.

How has it helped my organization?

By using this tool, a performance engineer was able to identify performance bottlenecks, and after fixes was applied, overall product quality improved.

What needs improvement?

It would be very useful if there was a mechanism to schedule performance runs.

For example, a mechanism to automatically schedule performance tests execution, by using the calendar scheduler. This way, it would be possible to schedule multiple runs overnight, without the need to manually start each performance test.

For how long have I used the solution?

I have used BlazeMeter with JMeter 3.0 and Java 1.8 for six months.

Buyer's Guide
BlazeMeter
December 2024
Learn what your peers think about BlazeMeter. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,121 professionals have used our research since 2012.

What do I think about the stability of the solution?

Stability was great; no issues.

What do I think about the scalability of the solution?

Scalability was great; no issues.

How are customer service and support?

I did not contact support.

Which solution did I use previously and why did I switch?

We did not previously use a different solution.

What's my experience with pricing, setup cost, and licensing?

I think prices are reasonable.

Which other solutions did I evaluate?

Before choosing this product, we did not evaluate other options.

What other advice do I have?

It is an excellent and reliable tool. I liked it very much.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user613551 - PeerSpot reviewer
Lead Software QA Engineer at a tech services company with 51-200 employees
Consultant
It can push large numbers of simulated users at our applications and provides access to detailed reports.

What is most valuable?

The ability to push large numbers of simulated users at our applications and having access to detailed reports: This helps us to have peace of mind that our apps can stand up to production-level loads and beyond.

How has it helped my organization?

We no longer have to guess whether deploying new code will affect performance or not. This ensures we are ready to meet customer demand, even at peak traffic times.

What needs improvement?

I would like to have better insights when tests fail to run properly or when the load engines occasionally break. There have been times when a test fails to start, sometimes due to a bug in my script and other times due to a problem on BlazeMeter’s side, that have required contacting support. It would be better if the interface proved enough feedback via logs, etc., for me to determine the cause and possibly fix it without needing to wait for BlazeMeter support.

For how long have I used the solution?

I have used BlazeMeter for three years.

What do I think about the stability of the solution?

Occasionally, we have long wait times or trouble starting tests.

What do I think about the scalability of the solution?

One load engine was not sufficient to run the JMeter scripts that I’ve written. Scaling up to seven load engines largely eliminated these issues.

How is customer service and technical support?

Support is adequate. Getting initial responses for support issues can sometimes be slow.

How was the initial setup?

It was very straightforward to upload the JMeter scripts and supporting files, and start running tests.

What's my experience with pricing, setup cost, and licensing?

It is somewhat expensive, but the amount of testing and peace of mind it gives us is well worth the cost.

Which other solutions did I evaluate?

We considered creating our own internal JMeter farm, but in the end decided BlazeMeter would do a better job of end-to-end testing.

What other advice do I have?

If you are looking to improve your website performance and ensure maximum uptime by load testing your system from end to end, then there is no better solution that I have found. It is extremely simple to setup.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Buyer's Guide
BlazeMeter
December 2024
Learn what your peers think about BlazeMeter. Get advice and tips from experienced pros sharing their opinions. Updated: December 2024.
824,121 professionals have used our research since 2012.
PeerSpot user
Chief Technology Officer at a non-profit with 51-200 employees
Real User
We like the ability to run a test repeatedly and that it is easy to make small changes to the test.

What is most valuable?

  • Easy to make small changes to the test without reconfiguration, so we could step increases in load and find the limits without risk in breaking the test scripts. Consistent testing allows for confidence in the results and ease of use by the team.
  • Integration with New Relic - provides insight as to why the test had the results and how we can improve them. New Relic was already in our tool belt, so it was nice to not need to change to an unfamiliar tool.

How has it helped my organization?

Provided an easy to use tool to measure the performance of our most critical business application, along with the expertise of BlazeMeter to properly generate the test case.

It has allowed us to test the impact of vendor updates to their software on the performance of the web component, which we are now doing as updates get released (6 month release cycle, so only one retest thus far).

System Administrators are performing the testing, as the software isn't ours and we don't presently develop our own software this was a new need and we don't have anything to compare to other than anecdotal evidence from users. We were able to compare results post-testing by comparing Google Analytics data and found that the improvements we put into place as result of the testing did have positive effect on both pageload and generation timings along with improving the overall conversion rate for the tool as well.

What needs improvement?

It's a rather expensive tool for running just a few tests — which is our primary use case, if there was a pricing structure that met our use case price wouldn’t be of concern. Worth noting is that we requested they donate our use of the tool — and they did donate the tool for our use — so it did not cost us anything (which we are very thankful for as a nonprofit).

What do I think about the stability of the solution?

We encountered no stability issues in using it.

What do I think about the scalability of the solution?

We encountered no scalability issues, though we were testing at relatively low volumes.

How are customer service and technical support?

Any questions we had were addressed promptly by knowledgeable individuals.

Which solution did I use previously and why did I switch?

We wanted a solution that was easy to interpret and wouldn't require custom tooling beyond building the test. JMeter was the right tool for the job, and BlazeMeter's expertise and easy to use interface allowed us to readily view and compare results without needing to build a custom workflow.

How was the initial setup?

Creating the JMeter test case required some time on our part, partially due to JMeter not supporting JavaScript and the application we were testing requires JavaScript support. We were able to create a test to work around that limitation, but that's more due to BlazeMeter utilizing JMeter than it being a limitation of BlazeMeter as a platform.

What's my experience with pricing, setup cost, and licensing?

Cost is critical as a non-profit, and they donated our access as noted prior. Functionality is also critical — and they had the function we needed, were easy to configure, and integrated with New Relic which saved us a lot of time.

Which other solutions did I evaluate?

The alternative was to use Open Source tools to analyze the results, this solution was selected as we felt it would be faster and easier than rolling a custom solution which just wasn't warranted for how simple our situation is.

What other advice do I have?

It's free and easy to sign up and try, so give it a whirl and see if it meets your requirements. We found it met ours and more, helping us gain confidence from our customers and solve a nagging problem in the performance of a third-party application.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
AVP at a financial services firm with 10,001+ employees
Real User
Top 5
Easy to navigate and offers reasonable pricing but needs grouping features
Pros and Cons
  • "The stability is good."
  • "The should be some visibility into load testing. I'd like to capture items via snapshots."

What is our primary use case?

We primarily use the solution for performance testing. 

What is most valuable?

The solution is easy to navigate. 

The testing it offers is very useful and compatible with many platforms.

We don't have to maintain any infrastructure, as that is already provided by BlazeMeter. 

The real user monitoring feature is great.

I like that you can integrate JMeter script into the solution and run your load while testing a number of users.

The solution easily runs with end-user experience monitoring and you can run scripts right in the solution. 

The initial setup is pretty straightforward. 

The stability is good. 

The solution can scale. 

We have found the technical support to be quite helpful.

The pricing is quite reasonable.

What needs improvement?

We have already provided some sort of feedback for our BlazeMeter vendor who is directly interacting with us. We would like, for example, for there to be some sort of grouping features available. 

The should be some visibility into load testing. I'd like to capture items via snapshots. 

While they are in the cloud, it would be good to also offer on-premises options. 

For how long have I used the solution?

I've been using the solution for about ten years. It's been about a decade. We've used it for a while. 

What do I think about the stability of the solution?

We've found the stability to be reliable. We're not running into any performance issues at all. There are no bugs or glitches. It doesn't crash or freeze. 

What do I think about the scalability of the solution?

We are planning to scale up to more BlazeMeter products very soon. You can scale it well. We want to scale up to ten products a month.

How are customer service and technical support?

Technical support has been very good so far. They are helpful and responsive. We are satisfied with the assistance overall.

Which solution did I use previously and why did I switch?

We also use LoadRunner.

How was the initial setup?

The solution is very straightforward to implement. It's not overly complex or difficult. 

The deployment only takes one week or so. 

What's my experience with pricing, setup cost, and licensing?

The pricing of the solution is pretty good. It's not overly expensive.

We pay to license the solution every year. There are many types of license models. We have chosen the UH license model for which we pay every year.

What other advice do I have?

We're a customer and an end-user.

I'd advise a company considers multiple technologies to support its goals. 

I'd rate the solution at a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Real User
Enables us to monitor our application instances as well as our database to see where the bottlenecks are
Pros and Cons
  • "It has helped us simulate heavy load situations so we can fix performance issues ahead of time."
  • "My only complaint is about the technical support, where sometimes I found that they would not read into and understand the details of my question before answering it."

What is our primary use case?

We use BlazeMeter to run simple POST requests against our application to simulate heavy load. We can then monitor our application instances as well as our database to see where the bottlenecks are.

How has it helped my organization?

It has helped us simulate heavy load situations so we can fix performance issues ahead of time. This ensures that we are ready for real customer load.

What is most valuable?

The most valuable feature is simply the ability to have a basic POST request while simulating many users at one time. Being able to determine either a number of iterations or having all users hit the application for a duration, are both useful options.

What needs improvement?

My only complaint is about the technical support, see further details below regarding customer support.

It would improve the product if their Chrome extension allowed you to modify the JMeter settings.

For how long have I used the solution?

Less than one year.

What do I think about the stability of the solution?

So far I haven't encountered any issues so it seems very stable to me.

What do I think about the scalability of the solution?

We have only used basic, but for one thousand users, it works great.

How are customer service and technical support?

Their support is pretty good and normally gets back to me within one day. One time, instead of the support rep taking the time to understand the details of my inquiry and source of my confusion, they pointed me to documentation to assist me in finding the answer on my own.  On the documentation page, I had to go into a few links in order to find the answer. The rep could have easily said "here is the documentation where we have the information, and you'll need to go here and do this to fix your problem."

I appreciate when support makes it feel like they understand your exact issue and then tell you exactly how to fix it. I also prefer when support gives you exactly what you need as they know the product best.

Which solution did I use previously and why did I switch?

BlazeMeter was the first tool that I used.

How was the initial setup?

I found the initial setup to be pretty simple. I'm using JMeter, so I had to do a bit of research myself on how to change some of the JMeter settings that their Chrome add-on does not allow you to modify.

Which other solutions did I evaluate?

This solution was recommended by a colleague, and I did not evaluate other options.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Vendor
For heavy load testing on a specific application, we did not encounter any stability or scalability issues.

What is most valuable?

We were doing load testing. We were testing web servers, and we needed to confirm that our servers were performing as well as the old ones.

How has it helped my organization?

One example of what happened is that we noticed that there was a significant difference between our two sites. It turned out that there was a configuration on the network side so after we fixed that, the performance was much better.

It helped to identify where there were problems, and then we could go investigate and figure out what was going on. We didn't just do one test, but this was a one-time sanity check on the new environment. One time lasted three months, but during that time, I would say we did it once a week.

What needs improvement?

There was one feature that I wanted that they didn't have. The feature was starting two tests simultaneously, but keeping the data separate, and showing separate graphs from two different test instances on the same display.

What happened is that I was trying to run two tests at the same time so I would have to do one in one window, one in the other window, and there was a few seconds difference, which was okay. Then, I would have to take the tests in one browser, and compare them to the tests in another browser.

If they could combine functionality and put them side by side with the same scale for me, that would've been ideal. I was using one standard testing configuration.

For how long have I used the solution?

We used it, I would say, for three months, to do performance testing on a very specific application.

What do I think about the stability of the solution?

We did not encounter any stability issues.

What do I think about the scalability of the solution?

We didn't have any scalability issues. I can't remember how many users we had. We weren't doing incredible load testing. We were just using heavy load testing. There were no issues on the BlazeMeter side.

How are customer service and technical support?

I would rate the technical support as 9/10, as I used it quite a few times. There was one instance where there was a timing mixup with a support engineer, which I was disappointed about, but the service was totally great. I would call them up with a question, they would answer it. It was fine.

Which solution did I use previously and why did I switch?

I did not use any solution previously. I chose them because somebody else in my company had used them before, and had told me that they were very good.

How was the initial setup?

The setup was straightforward. We had a very simple setup. We had a very simple testing scenario. After I watched the one-hour video, how the thing works, and then it showed up your URLs to test, I entered that, and there were two options we had to choose. Technically, it was very straightforward just for pure load testing.

What's my experience with pricing, setup cost, and licensing?

The pricing was straightforward. That was no issue. To have the features, the special features that I wanted, realistically it could've been cheaper, but you get what you pay for. It was fair pricing, it was just a lot for our purchasing pipeline.

Which other solutions did I evaluate?

I did a small evaluation, not very intensive. I would say a very small evaluation. Nothing significant.

What other advice do I have?

I would say use it, but people also have to know that they have to do their own due diligence and they have to make sure that their servers are okay. My advice would be to gather statistics on the servers as the tests are running, so that if the test indicates that there's something wrong, you can quickly look to the CPU, to the memory, to get an idea if it looks like it's an internal issue, or if it looks like it's an external issue.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Anto Infanta - PeerSpot reviewer
Senior Test Engineer at a computer software company with 201-500 employees
MSP
Good support and documentation
Pros and Cons
  • "They have good support documentation and when we have contacted them, they helped to guide us."
  • "Having more options for customization would be helpful."

What is our primary use case?

We used BlazeMeter for our performance testing. It allows us to run our tests on the local area network. Its primary use is to make sure that applications can handle a high load before going into the production environment. It will generate a report with the results.

The clients come up with some of the test cases and we have to validate them.

How has it helped my organization?

Using this product has improved the way our organization does testing.

What is most valuable?

This is a customizable product.

The documentation is good.

The sharing works well.

What needs improvement?

Having more options for customization would be helpful.

For how long have I used the solution?

We have been using BlazeMeter for the last six months.

What do I think about the scalability of the solution?

We have about 20 users who run over 1,000 test cases.

How are customer service and technical support?

The technical support is good. They have good support documentation and when we have contacted them, they helped to guide us.

Which solution did I use previously and why did I switch?

I started working directly with Blazemeter. There is another person in the company who is using LoadRunner and it costs about $300 per year.

What's my experience with pricing, setup cost, and licensing?

The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan.

What other advice do I have?

I would rate this solution an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
reviewer1090242 - PeerSpot reviewer
Head of IT Enterprise Architecture at a transportation company with 1,001-5,000 employees
Real User
The addition of structure to our load testing process has saved us time
Pros and Cons
  • "BlazeMeter has allowed us to simplify and speed up our load testing process."
  • "A possible improvement could be the integration with APM tools."

What is our primary use case?

We use BlazeMeter to perform load testing on our different web portals. Starting from JMeter scripts and based on users' behavior, we use the BlazeMeter workspace to adjust ramp-up. We study contemporary users and different scenarios in order to meet business expectations in terms of the required SLA.

How has it helped my organization?

BlazeMeter has allowed us to simplify and speed up our load testing process. Before BlazeMeter, we used to set up an ad-hoc infrastructure with no formal structure in terms of the scope, or how and when to provision it. This meant additional costs in terms of resources and time for managing the load-test infrastructure.

What is most valuable?

The reuse of JMeter scripts has allowed us to have continuity with the past, meaning that we didn't need to change the way we write scripts and collaborate with business users. Furthermore, it has given us a common way to modelize our campaigns with different technical partners, or different development teams.

What needs improvement?

A possible improvement could be the integration with APM tools. Different plugins for the most common APM tools could help to reconcile traffic charges with application behavior. For example, a root cause analysis of bottlenecks or analysis of non-linear behavior in applications.

For how long have I used the solution?

One year.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free BlazeMeter Report and get advice and tips from experienced pros sharing their opinions.
Updated: December 2024
Buyer's Guide
Download our free BlazeMeter Report and get advice and tips from experienced pros sharing their opinions.