Try our new research platform with insights from 80,000+ expert users

TestRail vs Visual Studio Test Professional comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Sep 16, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

TestRail
Ranking in Test Management Tools
2nd
Average Rating
8.0
Reviews Sentiment
6.8
Number of Reviews
21
Ranking in other categories
No ranking in other categories
Visual Studio Test Professi...
Ranking in Test Management Tools
5th
Average Rating
8.4
Reviews Sentiment
7.2
Number of Reviews
52
Ranking in other categories
Functional Testing Tools (5th)
 

Mindshare comparison

As of March 2025, in the Test Management Tools category, the mindshare of TestRail is 13.0%, down from 13.5% compared to the previous year. The mindshare of Visual Studio Test Professional is 2.7%, down from 5.3% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Management Tools
 

Featured Reviews

StuartBarker - PeerSpot reviewer
A tool that provides effective test management and real-time reporting capabilities
I have faced some issues with the integration between TestRail and Jira where the status of tests is not displayed (in Jira) due to I suspect security settings on the browser. In a large corporate environment, it is not easily changed. The support wasn't particularly helpful. It would be great if I could create custom reports, ideally with a tool designed specifically for that.
ALFONSO LORENZO-RODRÍGUEZ - PeerSpot reviewer
Provides extensive extensions and plugins for seamless AI product development
Our primary use case for Visual Studio Test Professional is as a development tool. We develop software primarily in Python, specifically for applications related to artificial intelligence. We use frameworks like PyTorch for training models and developing applications using these models. This tool…

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"I was on the lookout for automation testing on the browser and I believe this tool is very interesting in that matter. The solution is useful for UI testing. You just need to add the URL that is to be checked."
"The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run."
"Integration with Confluence and JIRA."
"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."
"The product helps us create test cases and reports."
"I use the product to create test cases and share them with my team and manager."
"You don't need to follow complex procedures to create a test run, test case, etc."
"Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database."
"It's great for the development of .NET."
"The solution is very stable; there's nothing in relation to stability to complain about."
"The integrated unit testing and extensive search features have made things easier."
"The setup is easy and straightforward."
"Its initial setup process is easy."
"The documentation is easy, and it helps us solve our problems."
"The performance of Visual Studio Test Professional is valuable."
"The tool is free, resulting in no costs associated with its use. The absence of price makes it cost-effective."
 

Cons

"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry."
"Better prediction of text."
"TestRail by Gurock could improve by adding a defect management module tool. It would add a lot of value if I want to install it and I don't have Jira or an isolating team. For example, if I am providing a service it's separated from the development team, it then would be better to have defect management included with the test management. However, as it is now I need to be integrated with Jira or another defect management tool to complete the testing process."
"The test suite management has room for improvement as well as better reporting."
"I do see room for lots of improvement in it. In terms of usability, duplication with test cases and constant creation of projects isn't easy. There is also too much API integration into automation tools, which is not there in ALM with UFT. Instead of setting it up as a project and using it, we set it up as a system for usability. It also lacks in the traceability aspect. For traceability, you need to use the JIRA plugin and drag traceability on JIRA, but the functionality is still quite limited. The biggest gap is mainframe testing. It would be good if I could start with mainframe testing. Manual granting of access is another issue. There is no API that I could use with another system where it is automated. There is an API for loading somebody to a project but not for adding to the application."
"The reports should be more user-friendly."
"With TestRail, the APIs are there, but they may not be able to easily integrate with the Jenkins."
"Visual Studio Test Professional needs to improve its scalability."
"The vendor must release a lightweight version of the solution."
"The performance could be faster."
"The documents on the Microsoft website are not very useful, and they ought to make it easier to find answers."
"The product must provide more automation."
"In Visual Studio we still don't have anything which can pinpoint memory leaks on a certain code line."
"Visual Studio Test Professional is expensive."
"I would appreciate some enhancements in the interface, maybe adding more color options."
 

Pricing and Cost Advice

"Negotiate the best deal you can."
"The price of the solution is based on how many users you have per year. When you grow, it is segmented, For example, 10 to 25, you have a price, and more than 50, or 100, you need to take the enterprise license. I don't think we will reach this point."
"Its price is definitely not more. If they introduce automation, they can charge more."
"The product has a reasonable price in terms of the features."
"Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time."
"Pricing for small teams seems correct with respect to competitors."
"My advice to others is to shop around for the best deal. Some options out there are free in cyberspace."
"I give the price a five out of ten."
"Visual Studio Test Professional is not an expensive solution."
"It is a price-effective solution"
"Our company pays a yearly licensing fee for Visual Studio Test Professional."
"We pay a yearly licensing fee for Visual Studio Test Professional, which is expensive."
"The tool is expensive in my region."
"We use the solution’s community version, and the solution’s pricing could be cheaper."
"The product is very expensive."
"We have licensing for Visual Studio Community edition."
report
Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
841,004 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
21%
Manufacturing Company
10%
Financial Services Firm
10%
Insurance Company
6%
Financial Services Firm
21%
Computer Software Company
16%
Manufacturing Company
9%
Real Estate/Law Firm
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Visual Studio Test Professional?
The most valuable features of the solution are its ease of use and availability.
What is your experience regarding pricing and costs for Visual Studio Test Professional?
The tool is free, resulting in no costs associated with its use. The absence of price makes it cost-effective.
What needs improvement with Visual Studio Test Professional?
The product needs contextual help integrated within its interface. Currently, I need to search online to find out how to use certain functions. This feature would save time by providing direct assi...
 

Also Known As

TestRail by Gurock
No data available
 

Overview

 

Sample Customers

Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung
Transport for Greater Manchester, Ordina, Bluegarden A/S, CLEAResult, Jet.com, OSIsoft, Australian Taxation Office, BookedOut, Tracasa
Find out what your peers are saying about TestRail vs. Visual Studio Test Professional and other solutions. Updated: January 2025.
841,004 professionals have used our research since 2012.