Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Visual Studio Test Professional comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
7.5
Apache JMeter is cost-effective, offering significant savings and effectiveness for high-demand performance testing, surpassing HP Performance Center.
Sentiment score
7.3
Visual Studio Test Professional boosts efficiency and reduces development time, enhancing ROI, though effectiveness varies by company needs.
 

Customer Service

Sentiment score
6.5
Apache JMeter support is community-driven and free, with varying response times; commercial options like BlazeMeter offer dedicated assistance.
Sentiment score
7.1
Visual Studio Test Professional's customer service is effective but can improve, with community support supplementing Microsoft's varied response times.
The support for Apache JMeter is excellent.
Apache JMeter relies more on community support.
Sometimes, the documentation is not readable, being too long or too detailed and not connected to my problem.
 

Scalability Issues

Sentiment score
6.3
Apache JMeter scales well with distributed testing, enhanced by cloud tools, but faces challenges at high loads and configurations.
Sentiment score
7.5
Visual Studio Test Professional is praised for scalability, supporting various team sizes and extensive projects despite licensing cost concerns.
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
This restricts the number of users and necessitates increasing load agents or distributing the script across multiple machines.
Without location dependency, it's rated ten out of ten, but with dependency, it can be six out of ten.
 

Stability Issues

Sentiment score
6.5
Apache JMeter is stable but may require specific configurations for high loads; community support exists for optimal performance.
Sentiment score
7.9
Users generally find Visual Studio Test Professional stable and reliable, though occasional slowdowns or crashes may occur with third-party systems.
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
Several necessary features still need improvements, specifically in terms of reports and additional functionalities compared to other commercial tools.
 

Room For Improvement

Apache JMeter faces criticism for its complex GUI, performance issues, limited automation, documentation, and integration challenges.
Visual Studio Test Professional needs improvements in usability, performance, affordability, and features like automation, platform support, and cloud integration.
Enabling the conversion of scripts from commercial tools like LoadRunner or NeoLoad into JMeter scripts would also be advantageous.
Currently, we need to use multiple separate JMeter instances to simulate reductions in load, which isn't ideal.
With BlazeMeter, you can view the results in real-time.
Sometimes, the library version is not compatible with other libraries, causing errors in my application.
The Git extensions are very basic and can be more extensive compared to other software focused on Git, like GitTower or SmartGit.
 

Setup Cost

Apache JMeter is cost-effective and scalable, appealing to enterprises for its flexibility and extensive community support.
Visual Studio Test Professional offers value with extensive features, despite being costly at $52 monthly or $1,300 annually.
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
It's a cost-effective solution.
Apache JMeter is completely free as it is open-source.
The price is expensive.
 

Valuable Features

Apache JMeter provides an open-source, scalable solution with extensive plugins, effective reporting, and strong community support for performance testing.
Visual Studio Test Professional is valued for its user-friendly interface, extensive features, and seamless integration with Microsoft tools.
Monetary benefits with Apache JMeter are notable since it doesn’t require a licensed version.
JMeter facilitates scripting capabilities, which include options for Groovy scripts.
Despite being open source, it offers features comparable to paid tools.
It supports cross-platform functionality.
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
92
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
Visual Studio Test Professi...
Average Rating
8.4
Reviews Sentiment
7.2
Number of Reviews
51
Ranking in other categories
Functional Testing Tools (6th), Test Management Tools (5th)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 24.7%, up 22.2% compared to last year.
Visual Studio Test Professional, on the other hand, focuses on Functional Testing Tools, holds 0.7% mindshare, down 1.1% since last year.
Performance Testing Tools
Functional Testing Tools
 

Featured Reviews

AlexLogan - PeerSpot reviewer
It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve
I rate JMeter five out of 10. You need knowledgeable employees to work with the tool because it's difficult to learn. There is a steep learning curve, so you shouldn't expect an entry-level engineer to pick up the tool quickly and become proficient. It takes a considerable amount of time.
Roger_Morera - PeerSpot reviewer
Customization is a key feature as is the ability to integrate with third-party services
Customization is the most powerful feature of this product because you can mold and design to your requirements. It's possible, for example, to build an OCR test from PDF or work files or build your own component based on OCR provisions and obtain the data required to process. If you extract a bill you can get the identification of the vendor or IT of the product, its quantity, value, unit, and additional information. Test Professional has the advantage of being able to integrate with any kind of third-party service which is very useful for the programming phase. It also has the ability to integrate without programming or the need for developing any APIs or services to integrate with robots. A regular user can do it.
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
824,053 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
16%
Manufacturing Company
8%
Government
7%
Financial Services Firm
18%
Computer Software Company
15%
Manufacturing Company
9%
Government
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
What do you like most about Visual Studio Test Professional?
The most valuable features of the solution are its ease of use and availability.
What is your experience regarding pricing and costs for Visual Studio Test Professional?
The tool is free, resulting in no costs associated with its use. The absence of price makes it cost-effective.
What needs improvement with Visual Studio Test Professional?
There are not any specific areas for improvement since there are so many libraries and frameworks already available, and we have not even touched everything yet.
 

Also Known As

JMeter
No data available
 

Learn More

 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Transport for Greater Manchester, Ordina, Bluegarden A/S, CLEAResult, Jet.com, OSIsoft, Australian Taxation Office, BookedOut, Tracasa
Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools. Updated: December 2024.
824,053 professionals have used our research since 2012.