BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.
The most valuable features of BlazeMeter include its user-friendly nature, ability to conduct distributed load testing, comprehensive analysis and reporting features, flexibility in choosing open-source technologies, integration with various tools such as AppDynamics and Splunk, support for cloud-based and open-source testing, API monitoring and Mock Services, orchestration of JMeter scripts, cloud-based load generators, graphical visualization of test results, object repository for web elements, and action groups for reusable test components. BlazeMeter also helps bridge Agile and CoE teams, implement shift-left testing, and improve software quality. It offers a range of test tools, supports multiple platforms, and eliminates the need for maintaining infrastructure. The solution is stable, easy to navigate, and provides real user monitoring and end-user experience monitoring capabilities. Technical support is helpful, and pricing is reasonable.
BlazeMeter has several areas that could benefit from improvement. One area is its integration with GitLab, which may need further enhancements in terms of compatibility. Currently, BlazeMeter works well with Git and Jenkins, but its level of integration with GitLab is uncertain. Another area that needs improvement is the seamless integration with mobiles. While BlazeMeter has UI testing capability and supports browsers like Chrome, Firefox, and Safari, there is a need for the capability to test Chrome on Windows, Mac OS, Android OS, and iOS. Additionally, BlazeMeter requires more granular access control. Currently, access control is limited to workspace level, and users can view or modify anything within that workspace based on their role. It would be beneficial to have more specific control over user permissions and access to different functionalities. There is also a need for a skilled staff to operate BlazeMeter effectively. While the solution is user-friendly, some teams have had to onboard new resources to utilize it fully. There are also minor bugs encountered, and the ability to add load generators to workspaces without relying on APIs would be desirable. In terms of reporting, BlazeMeter's Timeline Report panel lacks customization options and a time filter, unlike ELK. This limits the filtering options for requests based on specific time frames. During test execution, it can take some time to download data, which can be a drawback when running performance testing in live situations. The download time is unavoidable due to the functionality implemented in BlazeMeter, but it can be a pain point when running multiple tests. There are also concerns regarding the visibility of usernames and passwords in JMX files used for performance testing, as well as the lack of support for MQ protocol and JDBC in BlazeMeter's Mock Services. BlazeMeter's API monitoring also lacks a data-driven approach, which means multiple steps or duplications are required for test cases with multiple data sets. The ability to directly add test data from an Excel sheet would be beneficial. Data management and test server virtualization are areas where Perforce, the company behind BlazeMeter, should focus on improving. While BlazeMeter has good test data features, version control for test data is not yet included. Additionally, there is a need for better support and more efficient documentation. Improvements can also be made in terms of reporting capabilities, including the incorporation of tools like APM or Dynatrace. Other desired features include grouping options, visibility into load testing, the ability to capture items via snapshots, and on-premises options.
BlazeMeter has provided a positive return on investment for the users. By switching to BlazeMeter, they have been able to save money on infrastructure costs and scale their operations. The opportunity cost of using LoadRunner was high, as it limited their scope and scalability. With BlazeMeter, they have been able to generate more load and perform testing that was not possible before, resulting in a significant return on investment. Additionally, BlazeMeter has improved the quality of their software and increased productivity. The solution has saved them time and reduced overall test intervals, enabling fast feedback and confidence for stakeholders. Integration with other tools such as Jenkins and Digital.ai has been seamless, making automation and orchestration easier. The users have seen the value of BlazeMeter from the beginning and have added numerous functional test cases to the tool. Overall, BlazeMeter has proven to be a valuable investment.
BlazeMeter offers a consumption-based pricing model with a ceiling called CVUs, which allows users to freely utilize the platform for API testing, GUI testing, and test data. The pricing also includes a separate charge for dedicated IPs. Although the product is not cheap, it is not the most expensive on the market, and users found that paying a higher price is justified by the quality BlazeMeter provides. Additionally, there is a free and open-source version of the solution available. The solution offers a good pricing structure, with various license models available, and users pay annually under the chosen license model.
BlazeMeter is primarily used for load testing, performance testing, and API testing across various technologies such as web services, APIs, and web GUIs. It is used by multiple teams in different divisions, with a focus on simulating various types of loads and executing load tests. The solution offers a hybrid deployment model, with a combination of SaaS and on-premise components for executing load tests behind corporate firewalls. It simplifies the process of performance testing and provides features such as GUI testing, mock services, service virtualization, and test data capabilities. The solution is used by a telecommunications client for mock services and API monitoring, while another user uses it to execute performance testing for websites and mobile applications in a cloud environment. For 5G network testing, BlazeMeter provides a feedback loop, graphical user interface, and validation criteria to identify and address issues. Additionally, it is used for aggregating and reporting performance tests, creating automated functional tests, and scripting workload.
BlazeMeter's customer service and support has received high praise from users. They have been described as excellent, phenomenal, and very good. Users have commended their responsiveness, knowledge, and willingness to support. BlazeMeter's support team holds regular calls with users to address any concerns and provide updates on new features. This level of support is considered unique and impressive. Users have also reported that BlazeMeter's technical support has been able to meet all their needs. Overall, BlazeMeter's support is rated highly, with users expressing satisfaction and rating it a ten out of ten. However, there are a few users who have mentioned minimal support availability and inconsistent response times. Nevertheless, the majority of users have found BlazeMeter's support to be helpful, responsive, and satisfactory.
The initial setup for BlazeMeter is described as straightforward, easy, simple, containerized, and user-friendly. It involves creating accounts and workspaces, deploying Docker images, running commands, and downloading images. The setup process can take a few hours or one day, depending on the deployment type. Maintenance is described as light, with auto-updates enabled and a small team focusing on addressing customer knowledge gaps. Overall, the deployment and maintenance of BlazeMeter are considered relatively easy compared to other enterprise solutions.
BlazeMeter's solution is highly scalable, with the ability to increase usage and scale to any desired level. The scalability is controlled by the cloud vendor and the solution is built for scalability. The resources are in Docker containers, allowing for quick scaling within minutes if needed. The solution is used by a specific team for performance tests, and it can accommodate a large number of virtual users in different environments. There have been no issues with scalability, except for some reporting performance problems. While scalability testing has not been extensively done, the solution is considered good and suitable for small enterprises.
Based on the reviews, the overall consensus is that BlazeMeter is a stable solution. While there have been some occasional issues and challenges, they have been promptly addressed by the support team. Users have experienced high availability and reliability, with minimal instances of problems such as 404 errors. While there may be occasional back-end issues or maintenance, these are expected and not occurring frequently. Users are generally satisfied with the stability of BlazeMeter and have not encountered major issues or instability.
The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.
BlazeMeter was previously known as JMeter Cloud.
DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub