Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Visual Studio Test Professional comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
6.7
Apache JMeter, a cost-effective tool, excels in scalability, CICD integration, and ROI, rivaling HP Performance Center, with minimal investment.
Sentiment score
7.3
Visual Studio Test Professional boosts productivity and ROI, enhancing development speed and quality, while varying ROI across companies.
With Apache JMeter, I have gained great statistics for performance and server metrics.
 

Customer Service

Sentiment score
6.2
Apache JMeter's community-driven support provides helpful resources, but it's not as immediate or thorough as commercial alternatives.
Sentiment score
7.1
Visual Studio Test Professional's support is well-rated for responsiveness, knowledgeable staff, and helpful resources, despite navigation challenges.
The support for Apache JMeter is excellent.
Apache JMeter has strong support through its vast Java-based community on platforms like Stack Overflow.
Apache JMeter relies more on community support.
Sometimes, the documentation is not readable, being too long or too detailed and not connected to my problem.
 

Scalability Issues

Sentiment score
6.6
Apache JMeter is scalable but struggles with high loads, requiring distributed testing and complex configurations for extensive usage.
Sentiment score
7.5
Visual Studio Test Professional is highly scalable, effectively supporting various team sizes and projects despite cost and infrastructure considerations.
This restricts the number of users and necessitates increasing load agents or distributing the script across multiple machines.
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
For backend automation and performance testing with web services, web APIs, and queue management systems, I would rate Apache JMeter's scalability as between eight and nine.
 

Stability Issues

Sentiment score
7.2
Apache JMeter is generally stable and reliable but may require tuning for optimal performance under high load conditions.
Sentiment score
7.9
Visual Studio Test Professional is generally stable, with updates enhancing reliability, though occasional performance issues are reported.
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
Several necessary features still need improvements, specifically in terms of reports and additional functionalities compared to other commercial tools.
 

Room For Improvement

Apache JMeter faces challenges with SSL recording, performance issues, complex scripting, limited support, and inadequate documentation.
Visual Studio Test Professional needs improved performance, integration, usability, compatibility, and support for automation and web application testing.
Automating report analysis and supporting customized SLAs for script report generation could also enhance functionality.
With BlazeMeter, you can view the results in real-time.
The tool needs improvements related to client-side metrics, integrating with tools like YSlow or HTTP Watch, and enhancing mobile testing capabilities.
Sometimes, the library version is not compatible with other libraries, causing errors in my application.
The product needs contextual help integrated within its interface.
The Git extensions are very basic and can be more extensive compared to other software focused on Git, like GitTower or SmartGit.
 

Setup Cost

Apache JMeter is a cost-effective, open-source tool for smaller projects, with community support; high-scale testing needs additional tools.
Visual Studio Test Professional is costly but offers competitive value, priced at $52 monthly per user, with multi-user discounts.
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
Apache JMeter is completely free as it is open-source.
It's a cost-effective solution.
The price is expensive.
 

Valuable Features

Apache JMeter is a flexible, scalable, open-source tool for comprehensive performance testing with robust community support.
Visual Studio Test Professional excels in code testing, user interface, integration, debugging, and scalability for efficient software development.
Despite being open source, it offers features comparable to paid tools.
Monetary benefits with Apache JMeter are notable since it doesn’t require a licensed version.
JMeter facilitates scripting capabilities, which include options for Groovy scripts.
It supports cross-platform functionality.
Visual Studio Test Professional is highly valuable because it provides extensive extensions and plugins that assist in measuring code quality.
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
93
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
Visual Studio Test Professi...
Average Rating
8.4
Reviews Sentiment
7.2
Number of Reviews
52
Ranking in other categories
Functional Testing Tools (5th), Test Management Tools (5th)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 24.1%, up 23.4% compared to last year.
Visual Studio Test Professional, on the other hand, focuses on Functional Testing Tools, holds 0.6% mindshare, down 0.9% since last year.
Performance Testing Tools
Functional Testing Tools
 

Featured Reviews

Sreenivasula Mukkamalla - PeerSpot reviewer
Leveraging cost-effective customization with powerful plugins but complexity reduction needed
Apache JMeter offers plugins for reporting and preparing test scenarios. It allows recording to customization, letting you download plugins to connect with databases or external systems. Despite being open source, it offers features comparable to paid tools, and its ability to customize and expand is particularly useful. Additionally, its open-source nature makes it cost-effective.
ALFONSO LORENZO-RODRÍGUEZ - PeerSpot reviewer
Provides extensive extensions and plugins for seamless AI product development
Our primary use case for Visual Studio Test Professional is as a development tool. We develop software primarily in Python, specifically for applications related to artificial intelligence. We use frameworks like PyTorch for training models and developing applications using these models. This tool…
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
842,388 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
20%
Computer Software Company
16%
Manufacturing Company
7%
Government
7%
Financial Services Firm
22%
Computer Software Company
16%
Manufacturing Company
9%
Real Estate/Law Firm
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
What do you like most about Visual Studio Test Professional?
The most valuable features of the solution are its ease of use and availability.
What is your experience regarding pricing and costs for Visual Studio Test Professional?
The tool is free, resulting in no costs associated with its use. The absence of price makes it cost-effective.
What needs improvement with Visual Studio Test Professional?
The product needs contextual help integrated within its interface. Currently, I need to search online to find out how to use certain functions. This feature would save time by providing direct assi...
 

Also Known As

JMeter
No data available
 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Transport for Greater Manchester, Ordina, Bluegarden A/S, CLEAResult, Jet.com, OSIsoft, Australian Taxation Office, BookedOut, Tracasa
Find out what your peers are saying about Apache, Tricentis, Perforce and others in Performance Testing Tools. Updated: March 2025.
842,388 professionals have used our research since 2012.