BlazeMeter vs SmartBear TestComplete comparison

Perforce and SmartBear are both solutions in the Test Automation Tools category. Perforce is ranked #5 with an average rating of 8.0, while SmartBear is ranked #6 with an average rating of 7.6. Perforce holds a 0.5% mindshare in TAt, compared to SmartBear’s 6.5% mindshare. Additionally, 93% of Perforce users are willing to recommend the solution, compared to 87% of SmartBear users who would recommend it.

BlazeMeter

Read 47 BlazeMeter reviews

541 Views
299 Comparison Views

93% willing to recommend

SmartBear TestComplete

Read 75 SmartBear TestComplete reviews

5,396 Views
3,862 Comparison Views

87% willing to recommend

BlazeMeter

SmartBear TestComplete

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between BlazeMeter and SmartBear TestComplete based on real PeerSpot user reviews.

Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.

To learn more, read our detailed BlazeMeter vs. SmartBear TestComplete Report (Updated: October 2024).

Buyer's Guide

BlazeMeter vs. SmartBear TestComplete

October 2024

Download the complete report

Helped 816,406 peers since 2012

Categories and Ranking

BlazeMeter

Ranking in Functional Testing Tools

6th

Ranking in Test Automation Tools

5th

Average Rating

8.2

Reviews Sentiment

7.5

Number of Reviews

Ranking in other categories

Performance Testing Tools (4th), Load Testing Tools (4th)

SmartBear TestComplete

Ranking in Functional Testing Tools

7th

Ranking in Test Automation Tools

6th

Average Rating

7.6

Reviews Sentiment

7.3

Number of Reviews

Ranking in other categories

Regression Testing Tools (5th)

Mindshare comparison

As of November 2024, in the Test Automation Tools category, the mindshare of BlazeMeter is 0.5%, down from 0.6% compared to the previous year. The mindshare of SmartBear TestComplete is 6.5%, down from 7.9% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Test Automation Tools

Featured Reviews

Bala Maddu

Mobile Network Automation Architect at BT - British Telecom

Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases

Overall, it's helped our ability to address test data challenges. The test data features on their own are very good, but version control test data isn't included yet. I think that's an area for improvement. We can update the test data on the cloud. That's a good feature. There's also test data management, which is good. [Runscope] doesn't have the test data management yet. Mock services do, and performance testing has it. We can do the same test through JMeter, validating the same criteria, but the feedback from [Runscope] is quite visible. We can see the request and the response, what data comes back, and add the validation criteria. We can manage the test environments and test data, but running the same API request for multiple test data is missing. We cloned the test cases multiple times to run it. They need to work on that. Version controlling of the test cases and the information, the ability to compare the current version and the previous version within [Runscope] would be really nice. The history shows who made the changes, but it doesn't compare the changes. In the future, I would like to see integrations with GitLab and external Git reports so we could have some sort of version control outside as well. There is no current mechanism for that. The ability to have direct imports of spoken API specifications instead of converting them to JSON would be nice. There are some features they could work on.

Read full review

Prakhar Goel

Sr Test Lead at Emerson

Used for integration automation, user-based automation, and web automation

The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"The on-the-fly test data improved our testing productivity a lot. The new test data features changed how we test the applications because there are different things we can do. We can use mock data or real data. We can also build data based on different formats."

"Using cloud-based load generators is highly valuable to us, as we can test from outside our network and increase load generation without having to upscale our hardware as much. The cloud load generator is there when we need it and is the feature we leverage the most."

"BlazeMeter has allowed us to simplify and speed up our load testing process."

"The user interface is good."

"The most valuable aspect of BlazeMeter is its user-friendly nature, ability to conduct distributed load testing and comprehensive analysis and reporting features. It particularly excels in providing a clear and organized view of load test results."

"The feature that stands out the most is their action groups. They act like functions or methods and code, allowing us to reuse portions of our tests. That also means we have a single point for maintenance when updates are required. Instead of updating a hundred different test cases, we update one action group, and the test cases using that action group will update."

"BlazeMeter can be used for both API and performance testing, it is a multi-facility tool."

"It is focused on concurrency testing, which has been especially beneficial for us. Their previous experiences had caused major setbacks."

More BlazeMeter pros

"The most valuable feature is the integration with Azure DevOps."

"The database checkpoints detect problems which are difficult for a human resource to find."

"TestComplete has strong reporting capabilities. The reports they generate are really good."

"Selenium integration."

"It is a strong automation tool for desktop, browser, and API testing."

"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."

"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."

"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."

More SmartBear TestComplete pros

Cons

"I believe that data management and test server virtualization are things that Perforce is working on, or should be working on."

"In terms of improvement, I would like to have the ability to customize reports."

"Version controlling of the test cases and the information, the ability to compare the current version and the previous version within Runscope would be really nice. The history shows who made the changes, but it doesn't compare the changes."

"The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff."

"The should be some visibility into load testing. I'd like to capture items via snapshots."

"Lacks an option to include additional users during a test run."

"One problem, while we are executing a test, is that it will take some time to download data. Let's say I'm performance testing with a high-end load configuration. It takes a minimum of three minutes or so to start the test itself. That's the bad part of the performance testing... every time I rerun the same test, it is downloaded again... That means I have to wait for three to four minutes again."

"BlazeMeter needs more granular access control. Currently, BlazeMeter controls everything at a workspace level, so a user can view or modify anything inside that workspace depending on their role. It would be nice if there was a more granular control where you could say, "This person can only do A, B, and C," or, "This user only has access to functional testing. This user only has access to mock services." That feature set doesn't currently exist."

More BlazeMeter cons

"Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."

"Product is not stable enough and it crashes often."

"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."

"To bring it up to a 10, I would be looking for the addition of some key functional API testing."

"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."

"The integration tools could be better."

"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."

"One notable drawback is the absence of native integration with Git."

More SmartBear TestComplete cons

Pricing and Cost Advice

"The product pricing is reasonable."

"It is an averagely priced product."

"We pay a yearly licensing fee for the solution."

"I would rate the pricing a three out of ten, where one is very cheap, and ten is very expensive."

"It's consumption-based pricing but with a ceiling. They're called CVUs, or consumption variable units. We can use API testing, GUI testing, and test data, but everything gets converted into CVUs, so we are free to use the platform in its entirety without getting bogged down by a license for certain testing areas. We know for sure how much we are going to spend."

"The overall product is less costly than our past solutions, so we've absolutely saved money."

"The pricing is manageable. It is not that big. Big companies won't mind the licensing costs."

"I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."

More BlazeMeter pricing and cost advice

"The solution's pricing is too high."

"The pricing is a little above average — it could be lower."

"Overall, for us, the cost of the TestComplete platform and the three extra modules is around $8,000."

"The price of SmartBear TestComplete could be less. The main challenge is when it comes to node-locked. They should use a subscription model, such as a monthly-based subscription or, a quarterly-based subscription. Their floating license is very expensive, and this high price should be reduced or provide, at a minimum, a subscription model."

"We have a TestComplete 12 license."

"It comes with a high cost."

"TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."

"This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."

More SmartBear TestComplete pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.

See recommendations

816,406 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

21%

Computer Software Company

17%

Manufacturing Company

Retailer

Computer Software Company

19%

Manufacturing Company

13%

Financial Services Firm

12%

Government

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

How does BlazeMeter compare with Apache JMeter?

Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...

See all answers

What do you like most about BlazeMeter?

It has a unique programming dashboard that is very user-friendly.

See all answers

What is your experience regarding pricing and costs for BlazeMeter?

BlazeMeter's pricing is competitive but can be negotiable.

See all answers

What do you like most about SmartBear TestComplete?

TestComplete has strong reporting capabilities. The reports they generate are really good.

See all answers

What is your experience regarding pricing and costs for SmartBear TestComplete?

The solution's pricing is too high. On a scale from one to ten, where one is cheap and ten is expensive, I rate the solution's pricing nine and a half out of ten.

See all answers

What needs improvement with SmartBear TestComplete?

The learning curve of the solution's user interface is a little high for new users.

See all answers

Comparisons

Apache JMeter vs BlazeMeter

Compared 68% of the time

OpenText LoadRunner Cloud vs BlazeMeter

Compared 9% of the time

Tricentis NeoLoad vs BlazeMeter

Compared 9% of the time

OpenText LoadRunner Professional vs BlazeMeter

Compared 3% of the time

BrowserStack vs BlazeMeter

Compared 2% of the time

More BlazeMeter Competitors

Tricentis Tosca vs SmartBear TestComplete

Compared 21% of the time

Ranorex Studio vs SmartBear TestComplete

Compared 11% of the time

Katalon Studio vs SmartBear TestComplete

Compared 10% of the time

OpenText UFT One vs SmartBear TestComplete

Compared 10% of the time

Qt Squish vs SmartBear TestComplete

Compared 9% of the time

More SmartBear TestComplete Competitors

Product Reports

Buyer's Guide

BlazeMeter

November 2024

Download BlazeMeter product report

Buyer's Guide

SmartBear TestComplete

October 2024

Download SmartBear TestComplete product report

Also Known As

JMeter Cloud

No data available

Learn More

Perforce

SmartBear

Overview

BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.

The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.

What is SmartBear TestComplete?

TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

TestComplete offers three different testing scenarios:

Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.
Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.
Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

Key Features

Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.
Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.
Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.
Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

Reviews from Real Users

Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

Sample Customers

DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub

Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.

Buyer's Guide

BlazeMeter vs. SmartBear TestComplete

October 2024

Free Report: BlazeMeter vs. SmartBear TestComplete

Find out what your peers are saying about BlazeMeter vs. SmartBear TestComplete and other solutions. Updated: October 2024.

DOWNLOAD NOW

816,406 professionals have used our research since 2012.

See our BlazeMeter vs. SmartBear TestComplete report.

See our list of best Test Automation Tools vendors and best Functional Testing Tools vendors.

We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.