Try our new research platform with insights from 80,000+ expert users

Appium vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Appium
Ranking in Regression Testing Tools
6th
Average Rating
8.0
Reviews Sentiment
7.4
Number of Reviews
30
Ranking in other categories
Mobile Development Platforms (6th)
SmartBear TestComplete
Ranking in Regression Testing Tools
5th
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
76
Ranking in other categories
Functional Testing Tools (9th), Test Automation Tools (6th)
 

Mindshare comparison

As of April 2025, in the Regression Testing Tools category, the mindshare of Appium is 4.3%, down from 5.8% compared to the previous year. The mindshare of SmartBear TestComplete is 9.1%, down from 9.9% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Regression Testing Tools
 

Featured Reviews

Abhishek-Tiwari - PeerSpot reviewer
Has cross-platform flexibility and a record-and-play option
The challenging part with Appium is that installation can be a bit tricky. It can be challenging to set up in Android versus iOS environments. Appium has some limitations in terms of writing code using simulators and online cloud devices. I faced challenges with native based scenarios, battery turn out percentage, battery charging percentage, and memory capacity. The other challenge I faced involved codes changing from device to device. For example, the piece of code that works in iOS version 10.1 won't work in iOS version 6.0. In upcoming releases, if they can reduce some more of the dependencies like SDK, UIAutomator, etc., it would be great. That is, I'd like to see a consolidated package or bundle release that is much more user-friendly.
Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Obviously because of automation, it reduces manual testing efforts."
"It's an open-source solution with a very large community and available documentation."
"Appium's wide support of programming languages is valuable."
"Appium provides a record-and-play option, and the commands are the same as those that Selenium uses. So a person who has some exposure to Selenium will be able to write a piece of code in Appium."
"The best feature of Appium is that it allows you to inspect the element. With the Appium Inspector, you don't have to install another application to do the inspection. I also like that Appium has Android device connectivity. Currently, most people use Appium as automation software, and I haven't found any other tool that's more powerful than Appium."
"The solution is easy to use."
"The solution helps with test automation. We focus mostly on Java."
"It runs completely flawlessly and seamlessly every day."
"It allows us to test both desktop and web applications."
"When compared to other tools, it is very simple."
"The solution has a very nice interface."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"SmartBear TestComplete performs some self-healing and has a feature called OCR (optical character recognition)."
"It is a strong automation tool for desktop, browser, and API testing."
"The product is stable for what we are currently using it for, and it is sufficient for us."
 

Cons

"The user interface needs improvement because there are issues when setting up environment variables."
"Appium could improve by enabling record and run techniques similar to what they have in other licensing tools, such as Micro Focus. We have to all write the code, and then we can proceed."
"Image recognition could be improved. We have some images in our mobile applications. It should be able to run from the cloud, so we can automate the catcher."
"What needs improvement in Appium is its documentation. It needs to give more context on the libraries that Appium is using under the hood. For example, my team is using Appium for Android automation, and a lot of times, I feel that there's functionality that's available through the Appium interface, that exists within the UIAutomator, but there aren't a lot of useful or helpful resources on the internet to find that information, so it would be good to have some linkage with the underlying platform itself. Another room for improvement in Appium is that it's buggy sometimes. For example, at times, there's a bug in the inspector application that doesn't allow me to save my desired capability set, so it would be nice to get that bug fixed, but overall, Appium is a good tool. The Touch Actions functionality in Appium also needs improvement. For example, if I want to initiate a scroll on the device that I'm running Appium on, sometimes Swipe works, but in other situations, I have to explicitly use action chains, so I'm not too sure what's the better approach. What I'd like to see in the next version of Appium is a more intelligent and more intuitive AppiumLibrary, in terms of identifying menus and scroll bars, etc., because right now, I'm unsure if I have to do a lot of export reversals to get to the elements I'm looking for. It would be nice to have some functionality built in, which would allow me to easily get those exports."
"They should add an in-built framework."
"If it had more facility for configuration it would be a spectacular solution."
"It breaks down."
"Appium can improve when the case fails, there should be a feature where you can generate the report from Appium. Once you're on a test case, automatically the screenshot should be captured which would avoid manual intervention. These features would be beneficial to migrate to Appium."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"There could be API interfaces with this tool."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"The integration tools could be better."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"The recording function, when using Python, could be improved, as it does not work well in recording testing."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
 

Pricing and Cost Advice

"The solution is open source so it is free."
"As far as I know, Appium is a free solution. It's not for commercial use."
"Appian is open-source, which is not licensed."
"The pricing of Appium is fine."
"It's completely 100% free, and there are no hidden fees."
"The solution is open-source."
"There is no license for this solution because it is open-source."
"Appium is free and open-source."
"The solution's licensing cost has increased because it has moved to some new SLM-based licenses."
"The license price for a physical machine is cheap, and for virtual machine, it is very expensive."
"The price is less, compared to other products, such as QTP."
"My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
"TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
"The pricing is a little above average — it could be lower."
"Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
"It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools."
report
Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
845,040 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
15%
Manufacturing Company
9%
Retailer
6%
Computer Software Company
20%
Manufacturing Company
13%
Financial Services Firm
12%
Government
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Do you recommend Appium?
I do recommend Appium. It is an open-source solution and completely free of charge. We use Appium and Appium Studio as our base for any type of mobile automation for testing. It has a great interfa...
What do you like most about Appium?
Appium helps me to do as much as much as I want to.
What is your experience regarding pricing and costs for Appium?
My experience with Appium from a pricing perspective is favorable due to it being open source, making it a cost-effective option.
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I don't know much about the pricing, however, I think it's cheaper.
What needs improvement with SmartBear TestComplete?
The recording function, when using Python, could be improved, as it does not work well in recording testing.
 

Overview

 

Sample Customers

Nuvizz, Coupa Software, Eventbrite, Evernote
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about Appium vs. SmartBear TestComplete and other solutions. Updated: March 2025.
845,040 professionals have used our research since 2012.