We performed a comparison between TestRail and TFS based on real PeerSpot user reviews.
Find out in this report how the two Test Management Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run."
"The feature that I have found most valuable is the dashboard."
"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."
"The most valuable features are the reporting in the dashboard and the general way in which we can create test runs is helpful."
"The features that I have found most valuable are that there are various test case templates and test artifact maintenance."
"The solution is very stable. We've never had any issues with it."
"The most valuable features are the flexibility, ease of use for writing new test cases, the test plans, and the composition."
"You don't need to follow complex procedures to create a test run, test case, etc."
"It is a stable solution."
"This solution enables us to link all items usefully, in the way we use Agile."
"For what I need TFS for, I have never run into any limitation."
"TFS is very user-friendly."
"The most valuable features of TFS are the test plans. We can reproduce reusable test plans in test automation. We have a lot of queries and this feature is very useful."
"TFS' most valuable feature is the triage process. It is a robust solution that is easy to use."
"Version Control: TFS offers both the centralized “TFVC” version control technology as well as the distributed “Git” version control technology."
"The most valuable feature of TFS is the central repository, and you can see what changes other developers did from which branch."
"I have faced some issues with the integration between TestRail and Jira, which haven't been permanently resolved yet."
"It would be nice if they would add an export to Word."
"I do see room for lots of improvement in it. In terms of usability, duplication with test cases and constant creation of projects isn't easy. There is also too much API integration into automation tools, which is not there in ALM with UFT. Instead of setting it up as a project and using it, we set it up as a system for usability. It also lacks in the traceability aspect. For traceability, you need to use the JIRA plugin and drag traceability on JIRA, but the functionality is still quite limited. The biggest gap is mainframe testing. It would be good if I could start with mainframe testing. Manual granting of access is another issue. There is no API that I could use with another system where it is automated. There is an API for loading somebody to a project but not for adding to the application."
"The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry."
"The test suite management has room for improvement as well as better reporting."
"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."
"TestRail by Gurock could improve by adding a defect management module tool. It would add a lot of value if I want to install it and I don't have Jira or an isolating team. For example, if I am providing a service it's separated from the development team, it then would be better to have defect management included with the test management. However, as it is now I need to be integrated with Jira or another defect management tool to complete the testing process."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"As an end-user, I expect the solution's performance to be faster while staying as stable as possible."
"The manageability and performance of the product are areas of concern where improvements are required."
"This solution is quite old and it is already being bundled as Azure DevOps Server."
"TFS's CI/CD, project pipelines, and management development could be improved."
"I only use 1% of the functionality, so I am not familiar enough to know what needs to be improved."
"They should have design patterns in TFS for the development team, and design patterns for the QA."
"The execution of test cases could stand improvement."
"The user interface could improve and test management was not useful in TFS."
TestRail is ranked 2nd in Test Management Tools with 21 reviews while TFS is ranked 3rd in Test Management Tools with 93 reviews. TestRail is rated 8.0, while TFS is rated 8.0. The top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". On the other hand, the top reviewer of TFS writes "It is helpful for scheduled releases and enforcing rules, but it should be better at merging changes for multiple developers and retaining the historical information". TestRail is most compared with Zephyr Enterprise, Tricentis qTest, Tricentis Tosca, Sealights and OpenText ALM / Quality Center, whereas TFS is most compared with Microsoft Azure DevOps, Jira, Rally Software, OpenText ALM / Quality Center and Visual Studio Test Professional. See our TFS vs. TestRail report.
See our list of best Test Management Tools vendors.
We monitor all Test Management Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
