I work in a bank where we use BlazeMeter to conduct our load testing or performance testing. In our company, we utilize multiple machines, and multiple projects are hosted on BlazeMeter.
Performance Engineer Manager at a financial services firm with 1,001-5,000 employees
A tool for load testing or performance testing that needs to improve on its scalability part
Pros and Cons
- "The baseline comparison in BlazeMeter is very easy, especially considering the different tests that users can easily compare."
- "Scalability is an area of concern in BlazeMeter, where improvements are required."
What is our primary use case?
What is most valuable?
The baseline comparison in BlazeMeter is very easy, especially considering the different tests that users can easily compare. The response time and the calls we make in our company are easy to trace with the help of BlazeMeter.
What needs improvement?
There is a tab in Blazemeter named Request Stats Report where improvements are required. If I have to go and find a particular timeline, which might be in a 15 or 20-minute window, there are no places or options where I can enter the perfect or exact timelines I want to find. You have the pointers to drag from one place to another, but that doesn't give me much freedom to get or find a timeline. Basically, on a tab in Blazemeter named Request Stats Report, there should be the start time and end time. In BlazeMeter's Request Stats Report, users should have an option where they can select and manually enter the test start and test end time to get the stats for a particular time period.
Scalability is an area of concern in BlazeMeter, where improvements are required.
For how long have I used the solution?
I have been using BlazeMeter for a year.
Buyer's Guide
BlazeMeter
November 2024
Learn what your peers think about BlazeMeter. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
816,636 professionals have used our research since 2012.
What do I think about the stability of the solution?
The load testing time in BlazeMeter is too high since, in our company, we have seen that it takes four to five minutes to do an entire load testing process, and after that, we run the tests, which is a big problem for us.
Stability-wise, I rate the solution a five out of ten.
What do I think about the scalability of the solution?
I see certain limitations when it comes to the scalability part of BlazeMeter since, in our company, we have faced multiple interruptions, because of which we had to stop certain testing processes.
Scalability-wise, I rate the solution a five out of ten.
I cannot give you an exact number related to the number of users of BlazeMeter in our company since we are just one of the teams in the company that uses the tool. I believe that around 150 to 200 people in my company use BlazeMeter.
How are customer service and support?
I rate the technical support an eight out of ten.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
I only have experience with BlazeMeter.
How was the initial setup?
I rate the product's initial setup around seven on a scale of one to ten, where one is a difficult setup, and ten is an easy setup.
The time taken for the deployment of BlazeMeter varies since we have multiple types of applications in our company. If I have to deploy something on BlazeMeter, the time range for the deployment process can be somewhere between 30 to 120 minutes.
The solution is deployed on the cloud.
What other advice do I have?
BlazeMeter is a supportive tool in terms of the fact that it is easy to migrate from one system to another. BlazeMeter offers an easy infrastructure that allows for migration, if needed, in a well-organized manner, but it is not an optimized tool yet since I still see a lot of problems in it.
I rate the overall tool a seven out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Sales Leader at Better Now
Helps us implement shift-left testing, and ability to build test data on-the-fly helps us increase test coverage
Pros and Cons
- "One thing that we are doing a lot with the solution, and it's very good, is orchestrating a lot of JMeter agents. This feature has helped us a lot because we can reuse other vendors' performance scripts that they have used with JMeter before."
- "I believe that data management and test server virtualization are things that Perforce is working on, or should be working on."
What is our primary use case?
We are using it to execute performance testing for our website and mobile applications, including e-commerce solutions, internet banking, and more.
Our applications are in a cloud environment and have a lot of users using them at the same time. We are looking to create a better experience for the users. We execute this kind of performance setting to establish a baseline for response times and we use it to reduce them.
We are both a customer of BlazeMeter and a partner that implements it for other customers.
How has it helped my organization?
It helps us to work faster when doing performance testing. Because we're faster, we can better use our resources. We have more capacity for our backlog.
We have better visibility into test metrics by managing the reports and dashboards that present the results of test execution. That helps us to evaluate the performance parameters that the application should achieve. It has been great seeing the results that we are achieving.
It has definitely helped us to implement shift-left testing. By doing performance tests faster and earlier in the process, we have the opportunity to prevent performance issues in production. That aspect is very good.
In addition, the Scriptless Testing functionality means we can build a performance testing team in which some members don't need to have extreme programming or development experience. We can create a mixed team that has professionals with great expertise and less experienced people so that we can prepare them for the future.
Another benefit is the ability to build test data on-the-fly. That helps us increase test coverage. It's one of the main functionalities that helps us with that. It has also decreased our test cycle times by almost 35 percent, but I do believe that it could be even more than that.
What is most valuable?
One thing that we are doing a lot with the solution, and it's very good, is orchestrating a lot of JMeter agents. This feature has helped us a lot because we can reuse other vendors' performance scripts that they have used with JMeter before.
It can also be used for both performance and functional testing of any application and we can manage different kinds of data to better cover the performance and functional testing of the applications. For example, if we need different kinds of data to test the different uses of an application, we can use this platform to help us with that.
Another thing we like is that while it's difficult sometimes to connect this kind of performance test solution with application performance monitoring solutions, BlazeMeter has been great. Our experience with that has been great.
BlazeMeter is the perfect tool for us because it works with cloud and open source and other vendors' solutions. It's very good with other testing solutions in both our and our customers' ecosystems. For example, it's very good for perfecting mobile solutions and with other test data management solutions. It's very easy to integrate it into the software testing processes and tools that our customers are using.
It's also very good at bridging Agile and CoE teams. One thing that we are exploring right now, to make sure it works correctly, is the integration of BlazeMeter in the continuous integration and continuous delivery journey.
What needs improvement?
I believe that data management and test server virtualization are things that Perforce is working on, or should be working on.
For how long have I used the solution?
I have been using BlazeMeter for three to four years.
What do I think about the stability of the solution?
I don't recall having any issues with its stability. I'm extremely satisfied with that.
What do I think about the scalability of the solution?
The scalability is great. We can have a lot of virtual users when we need them.
We use BlazeMeter in different environments because we have customers with on-prem and cloud solutions.
How are customer service and support?
I'm very happy with the technical support. They have answered all our needs.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We went with BlazeMeter because we can easily access the platform through the internet and because it is very easy to incorporate it into our processes.
What was our ROI?
The return on investment is guaranteed with BlazeMeter. If you only look at the price, you will only see one side of the financial equation. We like to evaluate the return on investment in terms of reduced testing time, increased productivity, and the ability to deliver many more features into production with BlazeMeter.
Which other solutions did I evaluate?
I've worked with other performance testing, service virtualization, and test data management solutions. I have been working in the software testing area since 2000.
People love using JMeter, which is an open-source solution, but I prefer BlazeMeter because we can easily orchestrate a lot of testing. It has additional features that help make our performance and non-functional-requirements testing better, because we can integrate it with functional testing. And there are service virtualization and test data management features in the same solution. In a good number of cases, we only need BlazeMeter to do many things, rather than using two or three tools to do the same job. It's a single workplace where we can do many things.
What other advice do I have?
My advice would be not to look only at the price as the only point of decision. Evaluate if the tool is a good fit with your business and challenges.
We are using the SaaS solution. For companies that want to start, it's a better approach because it's easy to use: Pay and go. Of course, in large accounts, we are facing companies that are looking not only for cloud and private cloud, but for hybrid solutions where it is installed on-premises and in the cloud. BlazeMeter is up to this kind of challenge.
Adoption is a challenge that we face with every new tool or process. Because BlazeMeter is easy to use, we can adopt it faster. For developers and Agile teams, it's very helpful when we can use something quickly. That has helped a lot in the adoption.
The level of maintenance is okay. It is nothing that would create barriers for us. We have a team of eight people involved in the solution, and their roles include administration and performance testing.
Blazemeter is one of the top-three that I have found. It doesn't have any negative points compared to others.
Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor. The reviewer's company has a business relationship with this vendor other than being a customer: Partner
Buyer's Guide
BlazeMeter
November 2024
Learn what your peers think about BlazeMeter. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.
816,636 professionals have used our research since 2012.
Account Manager at a media company with 1-10 employees
Easy-to-configure platform with valuable reporting features
Pros and Cons
- "The product's most valuable features include its cloud-based nature, which allows us to conduct tests without relying on local resources."
- "The product could improve in areas such as mobile testing and the integration of AI analytics."
What is our primary use case?
We use the platform for performance and load testing to ensure our applications can handle varying traffic levels.
What is most valuable?
The product's most valuable features include its cloud-based nature, which allows us to conduct tests without relying on local resources.
Additionally, linking reports with Slack for notifications has greatly benefited our team’s communication.
What needs improvement?
The product could improve in areas such as mobile testing and the integration of AI analytics.
For how long have I used the solution?
I have been using BlazeMeter for about two weeks.
What do I think about the stability of the solution?
The product is stable.
What do I think about the scalability of the solution?
Our entire platform is on the Google Cloud Platform (GCP), and BlazeMeter’s ability to handle various load requirements seamlessly has been beneficial.
Which solution did I use previously and why did I switch?
We have used JMeter and Gatling in the past.
How was the initial setup?
The platform was easy to configure and integrate into our existing pipelines.
What about the implementation team?
We implemented the platform with the help of our in-house DevOps team.
What's my experience with pricing, setup cost, and licensing?
The product pricing is reasonable.
What other advice do I have?
I recommend BlazeMeter for its ease of setup and integration into continuous testing pipelines.
I rate it a nine out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Last updated: Aug 7, 2024
Flag as inappropriateTest Engineer at Deloitte
A fast solution for performance testing with easy setup
What is our primary use case?
We use the solution for performance testing. We create the safe to upload to BlazeMeter. Also, we can do standalone and combined load tests depending on the requirements.
What is most valuable?
BlazeMeter is quite fast and can be accessed through the web browser.
What needs improvement?
We sometimes experience downtime, but not so frequently.
What do I think about the stability of the solution?
The product is stable.
I rate the solution’s stability a seven out of ten.
How are customer service and support?
Customer support is fast.
How would you rate customer service and support?
Positive
Which solution did I use previously and why did I switch?
We opted for BlazeMeter because it is accessible through the web browser.
How was the initial setup?
The initial setup is straightforward.
What other advice do I have?
Multiple people can focus on the same instance. If anyone wants to view the result, So it's quite easy. You don't need to share the GTL file. You can access the browser.
Overall, I rate the solution a nine out of ten.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Data Modeler Manager / Application Development Manager at CIGNA Corporation
Easy integration of open source tools
What is our primary use case?
To load performance testing of web/mobile apps.
How has it helped my organization?
WIP.
What is most valuable?
- Simplicity
- Easy integration of open source tools
- Moderate migration of ALM scripts.
What needs improvement?
Reporting.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Quality Assurance Automation Engineer / Manager at a non-profit with 51-200 employees
I like the ability to spin up as many load generators as I need, and get statistics on response times and the load generators themselves.
What is most valuable?
I really like the ability to spin up as many load generators as I need, and get statistics on response times and the load generators themselves. BlazeMeter support and flexibility is also hugely valuable.
To accurately test load on a webserver it takes traffic (load) from multiple “load generators”.
A load generator is a machine running load testing software (like Jmeter).
Clearly, one couldn’t accurately test 10 load balanced webservers with traffic from a standard desktop.
If one did and saw performance issues, the most likely source would be the desktop doing the testing, or the connection.
If no performance issues were seen it could be that the desktop was not able to emulate the specified load.
One blind spot of Jmeter is it does not tell the user how many threads their machine can handle. Users need to know how to monitor. Most users don’t, and set the threads higher than the machine can handle.
Blazemeter:
- Handles all that complication and makes using Jmeter simple
- Has expert staff that can point you in the right direction if your tests are not working
- Allows users to select how many load generators (machines running Jmeter) will be used during a given test.
o There are a few different contract options (1 server, 5 servers)
o Custom contracts for any number of servers you need. I really appreciate their flexibility on the contracts.
How has it helped my organization?
Building an in-house group of load generation JMeter servers to load test usually takes time and effort. BlazeMeter makes all that simple.
For how long have I used the solution?
I have used JMeter for 4 years and BlazeMeter on and off for 2 to 3 years.
What do I think about the stability of the solution?
There were some minor issues with stability.
What do I think about the scalability of the solution?
We did not encounter any issues here. Scalability is one of the wonderful parts of working with BlazeMeter.
How are customer service and technical support?
Technical support has been great.
Which solution did I use previously and why did I switch?
I’ve used JMeter from several load generator servers I set up to work together.
How was the initial setup?
Initial setup was easy.
What's my experience with pricing, setup cost, and licensing?
If you don’t see the option you need, just ask them. You’ll be able to get a custom contract. It is not free, but it is a fantastic deal compared to anything else out there.
Most recently I have been using a custom contract with Blazemeter rather than a standard month to month contract. That allows me to pay by test hours times servers used. So I can spin up as many load generators as I need. The statistics on response times and the load generators themselves are standard Blazemeter features available to anyone with a contract. BlazeMeter support has several times helped me figure out what was going on with my tests, that saved me a chunk of time. It's always nice to have some insight from a true Jmeter expert.
Which other solutions did I evaluate?
We considered setting up our own set of load generation JMeter servers. We also looked at HPE LoadRunner and SoapUI.
What other advice do I have?
BlazeMeter is an easy way to get really accurate results from JMeters that you already have without having to build a set of networked JMeters (e.g., one with the UI running a bunch GUI-less slave machines).
Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
Senior Engineer at CIBER
Provides great flexibility and we can run executions from multiple locations
Pros and Cons
- "The solution offers flexibility with its configurations."
- "Lacks an option to include additional users during a test run."
What is our primary use case?
I mainly use BlazeMeter for scripting. I have a performance testing background, and can directly record my workload with the help of a BlazeMeter plugin. Once I've recorded I can modify a couple of enhancements. I can design my signature in BlazeMeter and choose multiple dedicated IPs, depending on our load. We are system integrators and I'm a senior engineer.
What is most valuable?
Providing the Cloud load generator is a good feature. We can run executions from multiple locations. Very few tools provide that. They have recently started with separate API testing. I haven't had a chance to use that yet but it might be very helpful. The solution offers flexibility with its configurations, taking around two to five minutes each. You can see the metrics in a graphical view while running the tests. Response times are also visible and can filter whatever we need and get the results of error loads.
What needs improvement?
Documentation for the solution could be improved because there are some areas, such as licensing costs, where there is a lack of information regarding structure. I'd also like the ability to see a comparison feature after carrying out several tests. I'd like to know the difference in terms of response times and other details. That would be a great feature for them to provide.
Sometimes we'd like to include additional users during a test run to check application sustainability. We can do it from a scripting end but it would be great if BlazeMeter would provide the option of adding a few more users while running a test.
For how long have I used the solution?
I've been using this solution for five years.
What do I think about the stability of the solution?
The stability is good.
What do I think about the scalability of the solution?
The scalability is good.
How are customer service and technical support?
If there are issues I update it in a chat and the technical support creates a ticket ID for follow-up. Sometimes they respond very quickly and other times they are very slow at resolving the issue. Response times are inconsistent.
How was the initial setup?
The initial setup is relatively straightforward and user-friendly. We have less than 50 users, we don't do any load tests.
What other advice do I have?
I recommend BlazeMeter because of the accuracy of the results.
I rate the solution eight out of 10.
Which deployment model are you using for this solution?
On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer: Integrator
AVP at a financial services firm with 10,001+ employees
Easy to navigate and offers reasonable pricing but needs grouping features
Pros and Cons
- "The stability is good."
- "The should be some visibility into load testing. I'd like to capture items via snapshots."
What is our primary use case?
We primarily use the solution for performance testing.
What is most valuable?
The solution is easy to navigate.
The testing it offers is very useful and compatible with many platforms.
We don't have to maintain any infrastructure, as that is already provided by BlazeMeter.
The real user monitoring feature is great.
I like that you can integrate JMeter script into the solution and run your load while testing a number of users.
The solution easily runs with end-user experience monitoring and you can run scripts right in the solution.
The initial setup is pretty straightforward.
The stability is good.
The solution can scale.
We have found the technical support to be quite helpful.
The pricing is quite reasonable.
What needs improvement?
We have already provided some sort of feedback for our BlazeMeter vendor who is directly interacting with us. We would like, for example, for there to be some sort of grouping features available.
The should be some visibility into load testing. I'd like to capture items via snapshots.
While they are in the cloud, it would be good to also offer on-premises options.
For how long have I used the solution?
I've been using the solution for about ten years. It's been about a decade. We've used it for a while.
What do I think about the stability of the solution?
We've found the stability to be reliable. We're not running into any performance issues at all. There are no bugs or glitches. It doesn't crash or freeze.
What do I think about the scalability of the solution?
We are planning to scale up to more BlazeMeter products very soon. You can scale it well. We want to scale up to ten products a month.
How are customer service and technical support?
Technical support has been very good so far. They are helpful and responsive. We are satisfied with the assistance overall.
Which solution did I use previously and why did I switch?
We also use LoadRunner.
How was the initial setup?
The solution is very straightforward to implement. It's not overly complex or difficult.
The deployment only takes one week or so.
What's my experience with pricing, setup cost, and licensing?
The pricing of the solution is pretty good. It's not overly expensive.
We pay to license the solution every year. There are many types of license models. We have chosen the UH license model for which we pay every year.
What other advice do I have?
We're a customer and an end-user.
I'd advise a company considers multiple technologies to support its goals.
I'd rate the solution at a seven out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free BlazeMeter Report and get advice and tips from experienced pros
sharing their opinions.
Updated: November 2024
Product Categories
Performance Testing Tools Functional Testing Tools Load Testing Tools Test Automation ToolsPopular Comparisons
Apache JMeter
Tricentis NeoLoad
OpenText LoadRunner Professional
Perfecto
OpenText LoadRunner Cloud
OpenText LoadRunner Enterprise
ReadyAPI
Eggplant Performance
RadView WebLOAD
Akamai CloudTest
SmartBear LoadNinja
Buyer's Guide
Download our free BlazeMeter Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- How does BlazeMeter compare with Apache JMeter?
- When evaluating Load Testing Tools, what aspect do you think is the most important to look for?
- SOAtest vs. SoapUI NG Pro?
- Does Compuware have a manual testing solution? Which manual testing solutions should we be considering?
- What are the top performance tools available to load test web applications?
- What is the best tool for mobile native performance testing on real devices?
- When evaluating Performance Testing Tools, what aspect do you think is the most important to look for?
- Cost of TOSCA Testsuite?
- Do you have an RFP template for Testing Tools which you can share?
- Specflow vs Selenium