Try our new research platform with insights from 80,000+ expert users

IBM Engineering Test Management vs TestRail comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Sep 16, 2024
 

Categories and Ranking

IBM Engineering Test Manage...
Ranking in Test Management Tools
7th
Average Rating
7.6
Reviews Sentiment
7.4
Number of Reviews
11
Ranking in other categories
Load Testing Tools (14th)
TestRail
Ranking in Test Management Tools
2nd
Average Rating
8.0
Reviews Sentiment
6.8
Number of Reviews
21
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of December 2024, in the Test Management Tools category, the mindshare of IBM Engineering Test Management is 2.8%, down from 3.1% compared to the previous year. The mindshare of TestRail is 12.8%, down from 13.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Management Tools
 

Featured Reviews

HZ
Scalable and Stable solution with good integration function and support team
IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing. So after we do that, we can put in all the code, then I can build it, then put all the test cases, and put all the build code for the shared location. And then rational that shared location means that RQM has access to the shared location. So, when we execute, if a test case is automated, we can run it from RQM. We need to have the environment ready for it to execute. Once we have that, then we can select the task case. So, by clicking on one button, the other environment is automatically plugged in. Then test results will be automatically transferred back to our RQM. So, in RQM, we can view it, and it is integrated. So we can run the test and the automation from RQM, and the test results will come back. Azure DevOps first test case is there, but then we tried to use Selenium to do half automation. Still, we realized that it wouldn't have the integration. We could do something in the pipeline, but it fires the Selenium test automation code. But then the test results won't be brought back or added to AzureDesk DevOps. That's something that I do hope that there can be another other system that can have this kind of integration. RQM can be improved because it's not related to our server and could be faster. We need to find out how much database storage is needed and keep increasing it. We heard that the latest version of RQM can clean up some old ones and give the same test result. But that one feature we are yet to use. It's a setting that we can set up, and then it goes automatically or gives me the choice to do it manually.
StuartBarker - PeerSpot reviewer
A tool that provides effective test management and real-time reporting capabilities
I have faced some issues with the integration between TestRail and Jira where the status of tests is not displayed (in Jira) due to I suspect security settings on the browser. In a large corporate environment, it is not easily changed. The support wasn't particularly helpful. It would be great if I could create custom reports, ideally with a tool designed specifically for that.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"RQM's best features are integration with test automation and performance testing."
"The one feature that has not allowed us to switch to any other solution is the integration with functional testing."
"It's very reliable as a solution."
"Reusability and integration capabilities which make it a great choice for organizations that use a variety of development tools and platforms."
"Integration with the other professional tools is a very strong advantage, so that we can have a traceability between the requirements and defects in Rational Team Concert. That's the most important aspect."
"It allows user to add whichever widget (predefined) based on the need. It has integration with CCM and RM to achieve traceability."
"RQM is something that we use everyday, so it has to be up and running, otherwise we would lose everything."
"Latest features include versioning of testings which can be great when used for multiple releases of a product."
"The solution is very stable. We've never had any issues with it."
"The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."
"The features that I have found most valuable are that there are various test case templates and test artifact maintenance."
"The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run."
"You don't need to follow complex procedures to create a test run, test case, etc."
"I was on the lookout for automation testing on the browser and I believe this tool is very interesting in that matter. The solution is useful for UI testing. You just need to add the URL that is to be checked."
"Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database."
"The feature that I have found most valuable is the dashboard."
 

Cons

"Mainly Quality Assurance and DevOps, but of course the whole company and management areas with more knowledge of quality and client success approach."
"RQM could be improved by adding a feature that allows test requirements to be selected when creating a task plan."
"I think it's fine from a performance perspective but usability is something that needs improvement."
"Adding support for uploading a collection of test cases would be a helpful addition."
"It would be helpful if we could assign a hierarchy to a group of test cases."
"Organizing the test cases is tedious. There is no mechanism to keep and maintain the test cases as hierarchy. This should be seriously addressed."
"Currently, the user interface needs to be more user-friendly."
"While RQM allows for running tests and viewing results, it could be further enhanced in terms of performance and speed."
"The test suite management has room for improvement as well as better reporting."
"TestRail's user interface is not great. When you use it for the first time, you will be very uncomfortable and not know how to create test cases. It doesn't have a field for preconditions and post-conditions."
"There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"TestRail by Gurock could improve by adding a defect management module tool. It would add a lot of value if I want to install it and I don't have Jira or an isolating team. For example, if I am providing a service it's separated from the development team, it then would be better to have defect management included with the test management. However, as it is now I need to be integrated with Jira or another defect management tool to complete the testing process."
"The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry."
"I do see room for lots of improvement in it. In terms of usability, duplication with test cases and constant creation of projects isn't easy. There is also too much API integration into automation tools, which is not there in ALM with UFT. Instead of setting it up as a project and using it, we set it up as a system for usability. It also lacks in the traceability aspect. For traceability, you need to use the JIRA plugin and drag traceability on JIRA, but the functionality is still quite limited. The biggest gap is mainframe testing. It would be good if I could start with mainframe testing. Manual granting of access is another issue. There is no API that I could use with another system where it is automated. There is an API for loading somebody to a project but not for adding to the application."
"TestRail should improve its pricing."
 

Pricing and Cost Advice

"The licenses of these tools (the whole CLM package) is very costly as compared to other vendors' tools."
"Each license includes 12 months of customer support. A free 90-day trial of the software is also available."
"I give the price a five out of ten."
"The product has a reasonable price in terms of the features."
"Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time."
"Pricing for small teams seems correct with respect to competitors."
"The price of the solution is based on how many users you have per year. When you grow, it is segmented, For example, 10 to 25, you have a price, and more than 50, or 100, you need to take the enterprise license. I don't think we will reach this point."
"The product is not much expensive."
"The solution is quite reasonably priced for what it offers and offers a monthly subscription model."
"My advice to others is to shop around for the best deal. Some options out there are free in cyberspace."
report
Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
824,053 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Healthcare Company
18%
Manufacturing Company
15%
Financial Services Firm
14%
Computer Software Company
13%
Computer Software Company
22%
Manufacturing Company
10%
Financial Services Firm
10%
Healthcare Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about IBM Rational Quality Manager?
The one feature that has not allowed us to switch to any other solution is the integration with functional testing.
What needs improvement with IBM Rational Quality Manager?
IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing. So after we do that, we can put in all the code, then I can build it, then pu...
What is your primary use case for IBM Rational Quality Manager?
We create test cases, and then we need to plan a new task plan feature from the existing task case file and execute the test results, which will be saved in RQM. So that is how we are using the too...
 

Also Known As

IBM Rational Quality Manager, Rational Quality Manager
TestRail by Gurock
 

Learn More

Video not available
 

Overview

 

Sample Customers

Ehrhardt, Cisco Systems, Anadolu Hayat Emeklilik, CareCore National, ItaÒ BBA, Barr
Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung
Find out what your peers are saying about IBM Engineering Test Management vs. TestRail and other solutions. Updated: December 2024.
824,053 professionals have used our research since 2012.