Try our new research platform with insights from 80,000+ expert users

SmartBear TestComplete vs TestRail comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
6.7
SmartBear TestComplete automation saves time, enhances client satisfaction, and boosts efficiency, with annual savings of approximately $10,000.
Sentiment score
8.0
TestRail improved productivity, collaboration, and accuracy in test management, providing valuable reporting, integrations, and an intuitive interface for users.
Once set up, only one person is needed to handle all tasks, reducing the requirement for multiple personnel.
Time-wise, it saves about fifteen to twenty percent compared to Excel, and money-wise, it's around ten percent.
 

Customer Service

Sentiment score
6.9
SmartBear TestComplete's customer support is knowledgeable but inconsistent, with delays and unresolved issues needing faster escalation and responses.
Sentiment score
4.0
TestRail's self-sufficient support has mixed reviews on communication and responsiveness; some seek improvements for complex issues.
Sometimes, you really need to speak to a person, and arranging such calls is not easy.
 

Scalability Issues

Sentiment score
7.3
SmartBear TestComplete is scalable and adaptable, with flexible scripting, but may require licensing for wider deployment.
Sentiment score
9.5
TestRail remains stable and scalable with minimal maintenance, effectively managing increasing users and data loads for organizations of all sizes.
I have never experienced any issues with its scalability.
 

Stability Issues

Sentiment score
6.9
SmartBear TestComplete generally stable, but users report crashes, memory leaks, and HTML5 testing delays in certain scenarios.
Sentiment score
9.7
TestRail is praised for its strong stability and reliability, with users consistently rating it highly for performance.
 

Room For Improvement

SmartBear TestComplete faces challenges in object recognition, integrations, licensing, performance, and support across browsers and mobile devices.
TestRail users seek enhanced reporting, better integrations, built-in defect management, and improved usability, performance, and automation features.
While using SmartBear TestComplete, we are fine with the current capabilities, however, it would be beneficial to improve some performance aspects, especially the image comparison feature.
TestRail lacks the functionality to map test cases to requirements and risks.
 

Setup Cost

SmartBear TestComplete's pricing and licensing receive mixed reviews, seen as both reasonable and costly depending on usage and modules.
Enterprise users have mixed opinions on TestRail pricing, recommending shopping around and negotiating for the best deals.
 

Valuable Features

SmartBear TestComplete excels in cross-platform automation, integration, and support for multiple languages, enhancing automated testing efficiency and maintenance.
TestRail excels in test management with intuitive organization, JIRA integration, user-friendly interface, real-time dashboards, and global accessibility.
The most valuable feature of SmartBear TestComplete for me is the image comparison functionality.
It significantly saves effort in managing test execution and managing all test cases.
 

Categories and Ranking

SmartBear TestComplete
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
76
Ranking in other categories
Functional Testing Tools (9th), Regression Testing Tools (5th), Test Automation Tools (6th)
TestRail
Average Rating
8.0
Reviews Sentiment
7.3
Number of Reviews
22
Ranking in other categories
Test Management Tools (2nd)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. SmartBear TestComplete is designed for Test Automation Tools and holds a mindshare of 5.9%, down 7.4% compared to last year.
TestRail, on the other hand, focuses on Test Management Tools, holds 12.2% mindshare, down 13.4% since last year.
Test Automation Tools
Test Management Tools
 

Featured Reviews

Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.
StuartBarker - PeerSpot reviewer
A tool that provides effective test management and real-time reporting capabilities
I have faced some issues with the integration between TestRail and Jira where the status of tests is not displayed (in Jira) due to I suspect security settings on the browser. In a large corporate environment, it is not easily changed. The support wasn't particularly helpful. It would be great if I could create custom reports, ideally with a tool designed specifically for that.
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
848,716 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
19%
Manufacturing Company
14%
Financial Services Firm
13%
Government
7%
Computer Software Company
20%
Financial Services Firm
10%
Manufacturing Company
10%
Insurance Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I am not involved in pricing or licensing; our management team handles these aspects.
What needs improvement with SmartBear TestComplete?
While using SmartBear TestComplete, we are fine with the current capabilities, however, it would be beneficial to improve some performance aspects, especially the image comparison feature. Occasion...
What is your experience regarding pricing and costs for TestRail by Gurock?
Pricing is reasonable for TestRail. It offers good value for money.
What needs improvement with TestRail by Gurock?
TestRail lacks the functionality to map test cases to requirements and risks. While integration with another tool is a workaround, it doesn't fully meet my needs. Additionally, I would appreciate A...
 

Also Known As

No data available
TestRail by Gurock
 

Overview

 

Sample Customers

Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung
Find out what your peers are saying about SmartBear TestComplete vs. TestRail and other solutions. Updated: April 2023.
848,716 professionals have used our research since 2012.