Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
7.5
Apache JMeter is cost-effective, offering significant savings and effectiveness for high-demand performance testing, surpassing HP Performance Center.
Sentiment score
6.6
SmartBear TestComplete enhances testing efficiency, reducing regression test time, achieving ROI in months, and improving client satisfaction with bug-free software.
 

Customer Service

Sentiment score
6.5
Apache JMeter support is community-driven and free, with varying response times; commercial options like BlazeMeter offer dedicated assistance.
No sentiment score available
The support for Apache JMeter is excellent.
Apache JMeter relies more on community support.
 

Scalability Issues

Sentiment score
6.3
Apache JMeter scales well with distributed testing, enhanced by cloud tools, but faces challenges at high loads and configurations.
No sentiment score available
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
This restricts the number of users and necessitates increasing load agents or distributing the script across multiple machines.
Without location dependency, it's rated ten out of ten, but with dependency, it can be six out of ten.
 

Stability Issues

Sentiment score
6.5
Apache JMeter is stable but may require specific configurations for high loads; community support exists for optimal performance.
No sentiment score available
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
Several necessary features still need improvements, specifically in terms of reports and additional functionalities compared to other commercial tools.
 

Room For Improvement

Apache JMeter faces criticism for its complex GUI, performance issues, limited automation, documentation, and integration challenges.
Enabling the conversion of scripts from commercial tools like LoadRunner or NeoLoad into JMeter scripts would also be advantageous.
With BlazeMeter, you can view the results in real-time.
Automating report analysis and supporting customized SLAs for script report generation could also enhance functionality.
 

Setup Cost

Apache JMeter is cost-effective and scalable, appealing to enterprises for its flexibility and extensive community support.
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
It's a cost-effective solution.
Apache JMeter is completely free as it is open-source.
 

Valuable Features

Apache JMeter provides an open-source, scalable solution with extensive plugins, effective reporting, and strong community support for performance testing.
It's useful for both the person conducting the test and the higher management, like project managers or senior executives, who may not know about the test.
JMeter facilitates scripting capabilities, which include options for Groovy scripts.
Despite being open source, it offers features comparable to paid tools.
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
92
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
SmartBear TestComplete
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
75
Ranking in other categories
Functional Testing Tools (5th), Regression Testing Tools (5th), Test Automation Tools (5th)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 24.7%, up 22.2% compared to last year.
SmartBear TestComplete, on the other hand, focuses on Test Automation Tools, holds 6.3% mindshare, down 7.7% since last year.
Performance Testing Tools
Test Automation Tools
 

Featured Reviews

AlexLogan - PeerSpot reviewer
It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve
I rate JMeter five out of 10. You need knowledgeable employees to work with the tool because it's difficult to learn. There is a steep learning curve, so you shouldn't expect an entry-level engineer to pick up the tool quickly and become proficient. It takes a considerable amount of time.
Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
824,067 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
16%
Manufacturing Company
8%
Government
7%
Computer Software Company
18%
Manufacturing Company
13%
Financial Services Firm
12%
Government
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I don't know much about the pricing, however, I think it's cheaper.
What needs improvement with SmartBear TestComplete?
The recording function, when using Python, could be improved, as it does not work well in recording testing.
 

Also Known As

JMeter
No data available
 

Learn More

 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools. Updated: December 2024.
824,067 professionals have used our research since 2012.