Try our new research platform with insights from 80,000+ expert users

BlazeMeter vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 15, 2024
 

Categories and Ranking

BlazeMeter
Ranking in Functional Testing Tools
7th
Ranking in Test Automation Tools
6th
Average Rating
8.2
Reviews Sentiment
6.9
Number of Reviews
47
Ranking in other categories
Performance Testing Tools (4th), Load Testing Tools (4th)
SmartBear TestComplete
Ranking in Functional Testing Tools
5th
Ranking in Test Automation Tools
5th
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
75
Ranking in other categories
Regression Testing Tools (5th)
 

Mindshare comparison

As of December 2024, in the Test Automation Tools category, the mindshare of BlazeMeter is 0.5%, down from 0.6% compared to the previous year. The mindshare of SmartBear TestComplete is 6.3%, down from 7.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Automation Tools
 

Featured Reviews

Bala Maddu - PeerSpot reviewer
Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases
Overall, it's helped our ability to address test data challenges. The test data features on their own are very good, but version control test data isn't included yet. I think that's an area for improvement. We can update the test data on the cloud. That's a good feature. There's also test data management, which is good. [Runscope] doesn't have the test data management yet. Mock services do, and performance testing has it. We can do the same test through JMeter, validating the same criteria, but the feedback from [Runscope] is quite visible. We can see the request and the response, what data comes back, and add the validation criteria. We can manage the test environments and test data, but running the same API request for multiple test data is missing. We cloned the test cases multiple times to run it. They need to work on that. Version controlling of the test cases and the information, the ability to compare the current version and the previous version within [Runscope] would be really nice. The history shows who made the changes, but it doesn't compare the changes. In the future, I would like to see integrations with GitLab and external Git reports so we could have some sort of version control outside as well. There is no current mechanism for that. The ability to have direct imports of spoken API specifications instead of converting them to JSON would be nice. There are some features they could work on.
Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The extensibility that the tool offers across environments and teams is valuable."
"It's a great platform because it's a SaaS solution, but it also builds the on-premises hosting solutions, so we have implemented a hybrid approach. BlazeMeter sets us up for our traditional hosting platforms and application stack as well as the modern cloud-based or SaaS-based application technologies."
"With the help of the Mock Services, we are overcoming everything. Wherever we are facing issues, whether they will be long term or temporary, by implementing the Mock Services we can bypass the faulty components that are not needed for our particular testing."
"For me, the best part is that we can graphically see the test result at runtime. It helps us understand the behavior of the application during all stages of the test."
"BlazeMeter has allowed us to simplify and speed up our load testing process."
"The solution offers flexibility with its configurations."
"The on-the-fly test data improved our testing productivity a lot. The new test data features changed how we test the applications because there are different things we can do. We can use mock data or real data. We can also build data based on different formats."
"The product's initial setup phase was simple."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"The product's initial setup phase was easy."
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"The initial setup is pretty easy and it's quick to deploy."
"It allows us to test both desktop and web applications."
"The solution has a very nice interface."
"The most valuable features are the desktop and mobile modules."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
 

Cons

"BlazeMeter needs more granular access control. Currently, BlazeMeter controls everything at a workspace level, so a user can view or modify anything inside that workspace depending on their role. It would be nice if there was a more granular control where you could say, "This person can only do A, B, and C," or, "This user only has access to functional testing. This user only has access to mock services." That feature set doesn't currently exist."
"BlazeMeter has room for improvement in terms of its integration with GitLab, particularly in the context of CI/CD processes. While it has multiple integrations available, the level of integration with GitLab may need further enhancements. It is known to work well with Git and Jenkins, although the extent of compatibility with GitLab is uncertain."
"The reporting capabilities could be improved."
"One problem, while we are executing a test, is that it will take some time to download data. Let's say I'm performance testing with a high-end load configuration. It takes a minimum of three minutes or so to start the test itself. That's the bad part of the performance testing... every time I rerun the same test, it is downloaded again... That means I have to wait for three to four minutes again."
"My only complaint is about the technical support, where sometimes I found that they would not read into and understand the details of my question before answering it."
"In terms of improvement, I would like to have the ability to customize reports."
"For a new user of BlazeMeter, it might be difficult to understand it from a programming perspective."
"BlazeMeter does not provide integration with the Aternity tool."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"The solution’s customer support should be improved."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"Right now, the product only supports Windows."
"Increased performance with less memory and CPU usage."
"If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
 

Pricing and Cost Advice

"I would rate the pricing a three out of ten, where one is very cheap, and ten is very expensive."
"When compared with the cost of the licenses of other tools, BlazeMeter's license price is good."
"The overall product is less costly than our past solutions, so we've absolutely saved money."
"I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."
"The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."
"It is an averagely priced product."
"The product pricing is reasonable."
"The product isn't cheap, but it isn't the most expensive on the market. During our proof of concept, we discovered that you get what you pay for; we found a cheaper solution we tested to be full of bugs. Therefore, we are willing to pay the higher price tag for the quality BlazeMeter offers."
"The solution is around $1500. Some are perpetual licenses, and some get a yearly report card."
"TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
"Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
"The product is becoming more and more expensive."
"The pricing is pretty reasonable."
"Overall, for us, the cost of the TestComplete platform and the three extra modules is around $8,000."
"This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
"The pricing is a little above average — it could be lower."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
824,067 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
21%
Computer Software Company
17%
Manufacturing Company
7%
Retailer
7%
Computer Software Company
18%
Manufacturing Company
13%
Financial Services Firm
12%
Government
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about BlazeMeter?
It has a unique programming dashboard that is very user-friendly.
What is your experience regarding pricing and costs for BlazeMeter?
BlazeMeter's pricing is competitive but can be negotiable.
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I don't know much about the pricing, however, I think it's cheaper.
What needs improvement with SmartBear TestComplete?
The recording function, when using Python, could be improved, as it does not work well in recording testing.
 

Also Known As

JMeter Cloud
No data available
 

Overview

 

Sample Customers

DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about BlazeMeter vs. SmartBear TestComplete and other solutions. Updated: November 2024.
824,067 professionals have used our research since 2012.