Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

TestRail
Ranking in Test Management Tools
2nd
Average Rating
8.0
Number of Reviews
21
Ranking in other categories
No ranking in other categories
TFS
Ranking in Test Management Tools
3rd
Average Rating
8.0
Number of Reviews
93
Ranking in other categories
Application Lifecycle Management (ALM) Suites (3rd)
 

Market share comparison

As of June 2024, in the Test Management Tools category, the market share of TestRail is 11.5% and it decreased by 22.6% compared to the previous year. The market share of TFS is 9.1% and it decreased by 36.1% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Management Tools
Unique Categories:
No other categories found
Application Lifecycle Management (ALM) Suites
4.2%
 

Featured Reviews

StuartBarker - PeerSpot reviewer
Sep 4, 2023
A tool that provides effective test management and real-time reporting capabilities
We use the solution for test management during projects The solution helps us with the general management of projects. It provides us with visibility on progress and quality. The most valuable feature of the solution is that it's an excellent repository for TestRail suite. TestRail provides…
SJ
May 5, 2023
Has good performance, but the initial setup process needs to be simpler
We use the solution to store all the code and designs for software version control The solution helps us store multiple software versions as it evolves and develops. All the essential functions of the solution perform well. The solution's pricing and setup process needs improvement. I have…

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"I was on the lookout for automation testing on the browser and I believe this tool is very interesting in that matter. The solution is useful for UI testing. You just need to add the URL that is to be checked."
"Reliable and stable. It is important that TestRail be up and running 24/7 as we have users around the world using it."
"I use the product to create test cases and share them with my team and manager."
"The feature that I have found most valuable is the dashboard."
"The API to support integration of the homemade automated testing tool."
"The product helps us create test cases and reports."
"This is a user friendly solution."
"The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."
"The most valuable feature of TFS is integration."
"The most valuable features of TFS are bug reporting and its high performance."
"The interface is easy to navigate."
"Complete integration with VS IDE and Office tools: This give us a possibility of high-level automation, thus minimizing human error."
"I feel that the test plan and test tools are more manageable in TFS."
"The most valuable features of TFS are the test plans. We can reproduce reusable test plans in test automation. We have a lot of queries and this feature is very useful."
"TFS’s test management capability without the expensive licensing has large gaps. Users will be unable to access performance testing and coded UI testing capabilities."
"The most valuable feature is simplicity."
 

Cons

"TestRail by Gurock could improve by adding a defect management module tool. It would add a lot of value if I want to install it and I don't have Jira or an isolating team. For example, if I am providing a service it's separated from the development team, it then would be better to have defect management included with the test management. However, as it is now I need to be integrated with Jira or another defect management tool to complete the testing process."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"I have faced some issues with the integration between TestRail and Jira, which haven't been permanently resolved yet."
"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
"It would be nice if they would add an export to Word."
"The reports should be more user-friendly."
"The project management side should be addressed and the project and release planning should be somewhat extended."
"The user interface could improve and test management was not useful in TFS."
"One of the areas that could be improved is to have an effective full lifecycle management."
"Sometimes we feel that it need more CPU, and RAMs on TFS server, either we implemented the hardware with the product minimum requirements."
"I would like to see the reporting features expanded so that I can see details on the users connected to all of the projects."
"Currently, we are looking for a solution with which we can incorporate third-party development sites or third-party project teams into the system. Because it is on-premise, it is a bit problematic because we need to have a VPN or something else in the system. A cloud-based solution would be better for us, and that's what we are looking for. Our biggest problem is the external connection, which, of course, is limited by our own IT. It would be good to have some kind of publishing service for this external connection. It might be there, and it might be that our IT is making it impossible for us. Its template editor could be easier to use. Currently, customizing the project templates according to your needs requires some work."
"I understand Microsoft is phasing out TFS in favor of Git, so I would steer anyone interested in TFS to look into Git."
"Not all of the functionality, which is exposed by the command line interface (tf.exe) is available in the Visual Studio GUI."
 

Pricing and Cost Advice

"Negotiate the best deal you can."
"I give the price a five out of ten."
"The product has a reasonable price in terms of the features."
"The solution is quite reasonably priced for what it offers and offers a monthly subscription model."
"Its price is definitely not more. If they introduce automation, they can charge more."
"The price of the solution is based on how many users you have per year. When you grow, it is segmented, For example, 10 to 25, you have a price, and more than 50, or 100, you need to take the enterprise license. I don't think we will reach this point."
"Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time."
"Pricing for small teams seems correct with respect to competitors."
"The pricing is reasonable at this time."
"I was working with the engineering team, and that was not under my umbrella. From what I can remember, its license was yearly. They had the licenses on a per-user basis, and they included MTM."
"I am not in a position to comment on the licensing terms, as we are talking about an enterprise arrangement."
"It's just as expensive as HPE ALM, without many of the features, best used for development tool only to avoid higher costs."
"TFS is not cheap."
"We are using the open-source version."
"The overall price of TFS is good."
"It is pretty expensive compared to other project management tools."
report
Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
787,061 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
23%
Manufacturing Company
10%
Financial Services Firm
10%
Healthcare Company
7%
Educational Organization
53%
Computer Software Company
7%
Manufacturing Company
5%
Financial Services Firm
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Which is better - TFS or Azure DevOps?
TFS and Azure DevOps are different in many ways. TFS was designed for admins, and only offers incremental improvements. In addition, TFS seems complicated to use and I don’t think it has a very fri...
What do you like most about TFS?
Microsoft's technical team is supportive.
What is your experience regarding pricing and costs for TFS?
There is a yearly licensing fee that needs to be paid.
 

Comparisons

 

Also Known As

TestRail by Gurock
Team Foundation Server
 

Learn More

 

Overview

 

Sample Customers

Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung
Vendex KBB IT Services, Info Support, Fujitsu Consulting, TCSC, Airways New Zealand, HP
Find out what your peers are saying about TFS vs. TestRail and other solutions. Updated: June 2024.
787,061 professionals have used our research since 2012.