SmartBear TestComplete vs TestRail comparison

The compared SmartBear and IDERA solutions aren't in the same category. SmartBear is ranked #5 in TAt , with an average rating of 7.7, and holds a 6.3% mindshare in the category. IDERA is ranked #2 in TMT , with an average rating of 8.4, and holds a 12.8% mindshare. Additionally, 87% of SmartBear users are willing to recommend the solution, compared to 90% of IDERA users who would recommend it.

SmartBear TestComplete

Read 75 SmartBear TestComplete reviews

5,069 Views
3,682 Comparison Views

87% willing to recommend

TestRail

Read 21 TestRail reviews

2,491 Views
1,139 Comparison Views

90% willing to recommend

SmartBear TestComplete

TestRail

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between SmartBear TestComplete and TestRail based on real PeerSpot user reviews.

Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.

To learn more, read our detailed SmartBear TestComplete vs. TestRail Report (Updated: April 2023).

Buyer's Guide

SmartBear TestComplete vs. TestRail

April 2023

Download the complete report

Helped 824,053 peers since 2012

Categories and Ranking

SmartBear TestComplete

Average Rating

7.6

Reviews Sentiment

6.8

Number of Reviews

Ranking in other categories

Functional Testing Tools (5th), Regression Testing Tools (5th), Test Automation Tools (5th)

TestRail

Average Rating

8.0

Reviews Sentiment

6.8

Number of Reviews

Ranking in other categories

Test Management Tools (2nd)

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. SmartBear TestComplete is designed for Test Automation Tools and holds a mindshare of 6.3%, down 7.7% compared to last year.
TestRail, on the other hand, focuses on Test Management Tools, holds 12.8% mindshare, down 13.2% since last year.

Test Automation Tools

Test Management Tools

Featured Reviews

Prakhar Goel

Sr Test Lead at Emerson

Used for integration automation, user-based automation, and web automation

The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.

Read full review

StuartBarker

Managing Director at Corecom Quality Engineering

A tool that provides effective test management and real-time reporting capabilities

I have faced some issues with the integration between TestRail and Jira where the status of tests is not displayed (in Jira) due to I suspect security settings on the browser. In a large corporate environment, it is not easily changed. The support wasn't particularly helpful. It would be great if I could create custom reports, ideally with a tool designed specifically for that.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."

"The ease-of-use and quality of the overall product are above average."

"TestComplete is simple, it's a very easy-to-use tool."

"The most valuable feature of this solution is regression testing tools."

"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."

"SmartBear TestComplete performs some self-healing and has a feature called OCR (optical character recognition)."

"Test items, project variables helps in managing automation suite and scheduling execution."

"It allows us to test both desktop and web applications."

More SmartBear TestComplete pros

"The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."

"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."

"Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database."

"I was on the lookout for automation testing on the browser and I believe this tool is very interesting in that matter. The solution is useful for UI testing. You just need to add the URL that is to be checked."

"From a testing perspective, the management is awesome. I am able to do testing and then add the reporting and the evidence. It is fair in terms of the price that you're paying. You get what you're paying for."

"The API to support integration of the homemade automated testing tool."

"You don't need to follow complex procedures to create a test run, test case, etc."

"The features that I have found most valuable are that there are various test case templates and test artifact maintenance."

More TestRail pros

Cons

"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."

"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."

"During the distribution of our regression test cases, the control IDs are not always recognized correctly."

"There could be API interfaces with this tool."

"This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail."

"The integration tools could be better."

"In scenarios where two of our engineers work on the same task, merging codes is a bit difficult."

"The artificial intelligence needs to be improved."

More SmartBear TestComplete cons

"Their customer support could be improved. Sometimes we struggle with that. It could be faster. Whenever we raise any query, they get back to you but the turnaround time is very slow."

"It would be nice if they would add an export to Word."

"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."

"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."

"TestRail should improve its pricing."

"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."

"The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry."

"The test suite management has room for improvement as well as better reporting."

More TestRail cons

Pricing and Cost Advice

"We have a TestComplete 12 license."

"SmartBear TestComplete is an expensive tool."

"The solution is around $1500. Some are perpetual licenses, and some get a yearly report card."

"The solution's licensing cost has increased because it has moved to some new SLM-based licenses."

"My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."

"Overall, for us, the cost of the TestComplete platform and the three extra modules is around $8,000."

"It comes with a high cost."

"The price is less, compared to other products, such as QTP."

More SmartBear TestComplete pricing and cost advice

"Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time."

"I give the price a five out of ten."

"My advice to others is to shop around for the best deal. Some options out there are free in cyberspace."

"The product has a reasonable price in terms of the features."

"The product is not much expensive."

"Negotiate the best deal you can."

"The price of the solution is based on how many users you have per year. When you grow, it is segmented, For example, 10 to 25, you have a price, and more than 50, or 100, you need to take the enterprise license. I don't think we will reach this point."

"Its price is definitely not more. If they introduce automation, they can charge more."

More TestRail pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.

See recommendations

824,053 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Computer Software Company

18%

Manufacturing Company

13%

Financial Services Firm

12%

Government

Computer Software Company

22%

Manufacturing Company

10%

Financial Services Firm

10%

Healthcare Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

What do you like most about SmartBear TestComplete?

TestComplete has strong reporting capabilities. The reports they generate are really good.

See all answers

What is your experience regarding pricing and costs for SmartBear TestComplete?

I don't know much about the pricing, however, I think it's cheaper.

See all answers

What needs improvement with SmartBear TestComplete?

The recording function, when using Python, could be improved, as it does not work well in recording testing.

See all answers

What do you like most about TestRail by Gurock?

I use the solution for test management.

See all answers

What is your experience regarding pricing and costs for TestRail by Gurock?

The product has a reasonable price in terms of the features.

See all answers

What needs improvement with TestRail by Gurock?

TestRail should improve its pricing.

See all answers

Comparisons

Tricentis Tosca vs SmartBear TestComplete

Compared 21% of the time

Ranorex Studio vs SmartBear TestComplete

Compared 11% of the time

OpenText UFT One vs SmartBear TestComplete

Compared 10% of the time

Qt Squish vs SmartBear TestComplete

Compared 10% of the time

Apache JMeter vs SmartBear TestComplete

Compared 1% of the time

More SmartBear TestComplete Competitors

Tricentis qTest vs TestRail

Compared 21% of the time

TFS vs TestRail

Compared 17% of the time

Zephyr Enterprise vs TestRail

Compared 13% of the time

Tricentis Tosca vs TestRail

Compared 8% of the time

Jira vs TestRail

Compared 6% of the time

More TestRail Competitors

Product Reports

Buyer's Guide

SmartBear TestComplete

November 2024

Download SmartBear TestComplete product report

Buyer's Guide

TestRail

November 2024

Download TestRail product report

Also Known As

No data available

TestRail by Gurock

Learn More

SmartBear

IDERA

Overview

What is SmartBear TestComplete?

TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

TestComplete offers three different testing scenarios:

Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.
Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.
Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

Key Features

Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.
Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.
Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.
Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

Reviews from Real Users

Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

TestRail helps you manage and track your software testing efforts and organize your QA department. Its intuitive web-based user interface makes it easy to create test cases, manage test runs and coordinate your entire testing process.

Easily track and follow the status of individual tests, milestones and projects with dashboards and activity reports. Get real-time insights into your testing progress and boost productivity with personalized todo lists, filters and email notifications. Efficient test management, get started today!

Sample Customers

Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.

Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung

Buyer's Guide

SmartBear TestComplete vs. TestRail

April 2023

Free Report: SmartBear TestComplete vs. TestRail

Find out what your peers are saying about SmartBear TestComplete vs. TestRail and other solutions. Updated: April 2023.

DOWNLOAD NOW

824,053 professionals have used our research since 2012.

See our SmartBear TestComplete vs. TestRail report.

We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.