Try our new research platform with insights from 80,000+ expert users

IBM Engineering Test Management vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

IBM Engineering Test Manage...
Average Rating
7.6
Number of Reviews
11
Ranking in other categories
Test Management Tools (8th), Load Testing Tools (15th)
SmartBear TestComplete
Average Rating
7.6
Number of Reviews
74
Ranking in other categories
Functional Testing Tools (7th), Regression Testing Tools (5th), Test Automation Tools (6th)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. IBM Engineering Test Management is designed for Test Management Tools and holds a mindshare of 2.9%, up 2.9% compared to last year.
SmartBear TestComplete, on the other hand, focuses on Test Automation Tools, holds 6.5% mindshare, down 7.9% since last year.
Test Management Tools
Test Automation Tools
 

Featured Reviews

HZ
May 18, 2023
Scalable and Stable solution with good integration function and support team
IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing. So after we do that, we can put in all the code, then I can build it, then put all the test cases, and put all the build code for the shared location. And then rational that shared location means that RQM has access to the shared location. So, when we execute, if a test case is automated, we can run it from RQM. We need to have the environment ready for it to execute. Once we have that, then we can select the task case. So, by clicking on one button, the other environment is automatically plugged in. Then test results will be automatically transferred back to our RQM. So, in RQM, we can view it, and it is integrated. So we can run the test and the automation from RQM, and the test results will come back. Azure DevOps first test case is there, but then we tried to use Selenium to do half automation. Still, we realized that it wouldn't have the integration. We could do something in the pipeline, but it fires the Selenium test automation code. But then the test results won't be brought back or added to AzureDesk DevOps. That's something that I do hope that there can be another other system that can have this kind of integration. RQM can be improved because it's not related to our server and could be faster. We need to find out how much database storage is needed and keep increasing it. We heard that the latest version of RQM can clean up some old ones and give the same test result. But that one feature we are yet to use. It's a setting that we can set up, and then it goes automatically or gives me the choice to do it manually.
Prakhar Goel - PeerSpot reviewer
Jun 25, 2024
Used for integration automation, user-based automation, and web automation
We have applications related to power plants, and we use the solution to do integration automation, user-based automation, and web automation The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a…

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"RQM's best features are integration with test automation and performance testing."
"Reusability and integration capabilities which make it a great choice for organizations that use a variety of development tools and platforms."
"The most valuable feature is the RFT because it allows us to automate manual test cases."
"It allows user to add whichever widget (predefined) based on the need. It has integration with CCM and RM to achieve traceability."
"It's very reliable as a solution."
"RQM is something that we use everyday, so it has to be up and running, otherwise we would lose everything."
"Latest features include versioning of testings which can be great when used for multiple releases of a product."
"The one feature that has not allowed us to switch to any other solution is the integration with functional testing."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The product is stable for what we are currently using it for, and it is sufficient for us."
"I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."
"It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows."
"When compared to other tools, it is very simple."
"It's cross platform automation capabilities specially ranging across web, UNIX (via putty), and other systems."
"The ease-of-use and quality of the overall product are above average."
"The product has many features."
 

Cons

"I think it's fine from a performance perspective but usability is something that needs improvement."
"Integration capabilities with other vendors' tools should improve."
"It would be helpful if we could assign a hierarchy to a group of test cases."
"Currently, the user interface needs to be more user-friendly."
"Organizing the test cases is tedious. There is no mechanism to keep and maintain the test cases as hierarchy. This should be seriously addressed."
"Mainly Quality Assurance and DevOps, but of course the whole company and management areas with more knowledge of quality and client success approach."
"Adding support for uploading a collection of test cases would be a helpful addition."
"RQM could be improved by adding a feature that allows test requirements to be selected when creating a task plan."
"Right now, when you buy the solution, you need to pay for one solution. You receive one set up and you install it and it's just in that one machine. It would be ideal if they could offer one subscription where you can connect to different machines with a group subscription."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
"The integration tools could be better."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"Increased performance with less memory and CPU usage."
 

Pricing and Cost Advice

"The licenses of these tools (the whole CLM package) is very costly as compared to other vendors' tools."
"Each license includes 12 months of customer support. A free 90-day trial of the software is also available."
"This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
"It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools."
"The pricing is pretty reasonable."
"Overall, for us, the cost of the TestComplete platform and the three extra modules is around $8,000."
"My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
"We have a TestComplete 12 license."
"The license price for a physical machine is cheap, and for virtual machine, it is very expensive."
"Our ROI is about $10,000 a year."
report
Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
814,649 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Manufacturing Company
15%
Healthcare Company
15%
Financial Services Firm
14%
Computer Software Company
13%
Computer Software Company
19%
Manufacturing Company
13%
Financial Services Firm
11%
Government
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about IBM Rational Quality Manager?
The one feature that has not allowed us to switch to any other solution is the integration with functional testing.
What needs improvement with IBM Rational Quality Manager?
IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing. So after we do that, we can put in all the code, then I can build it, then pu...
What is your primary use case for IBM Rational Quality Manager?
We create test cases, and then we need to plan a new task plan feature from the existing task case file and execute the test results, which will be saved in RQM. So that is how we are using the too...
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
The solution's pricing is too high. On a scale from one to ten, where one is cheap and ten is expensive, I rate the solution's pricing nine and a half out of ten.
What needs improvement with SmartBear TestComplete?
The learning curve of the solution's user interface is a little high for new users.
 

Also Known As

IBM Rational Quality Manager, Rational Quality Manager
No data available
 

Learn More

Video not available
 

Overview

 

Sample Customers

Ehrhardt, Cisco Systems, Anadolu Hayat Emeklilik, CareCore National, ItaÒ BBA, Barr
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about IBM Engineering Test Management vs. SmartBear TestComplete and other solutions. Updated: July 2020.
814,649 professionals have used our research since 2012.