We performed a comparison between Appium and SmartBear TestComplete based on real PeerSpot user reviews.
Find out in this report how the two Regression Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable features of Appium are the in-built functionality, which we can use in our code. For example, move back, move front, navigate one page before, and navigate one page ahead. You can do this by using the in-built functions from Appium."
"We develop apps using the React Native framework, and Appium integrates well for testing those apps. The Appium automation framework also has good integration with GitHub Actions and plenty of other tools and frameworks, including BrowserStack."
"It's an open-source solution with a very large community and available documentation."
"The automation part is extremely helpful in streamlining our processes."
"The latest versions of the solution are stable."
"Appium provides a record-and-play option, and the commands are the same as those that Selenium uses. So a person who has some exposure to Selenium will be able to write a piece of code in Appium."
"The solution is easy to use."
"Appium helps me to do as much as much as I want to."
"The solution has a very nice interface."
"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"It allows us to test both desktop and web applications."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"Customer service and technical support responsiveness are high. Everyone is very professional."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"If it had more facility for configuration it would be a spectacular solution."
"Appium can improve when the case fails, there should be a feature where you can generate the report from Appium. Once you're on a test case, automatically the screenshot should be captured which would avoid manual intervention. These features would be beneficial to migrate to Appium."
"The initial setup is straightforward if you have previous experience with the solution, but it can be complicated for a novice user."
"Appium has problems with automated validations following iOS updates, causing us to have to validate manually."
"They should add an in-built framework."
"The user interface needs improvement because there are issues when setting up environment variables."
"I rarely use Appium nowadays because I'm now at the managerial level, but the last time I used it, whenever I selected and clicked on an element, Appium was very slow. I tried to debug it, but I still couldn't find the problem, so this is an area for improvement in the solution. Another area for improvement lies with the connector and server. For example, the effort to get into the local machine sometimes causes the emulator to become slow, which then leads to failure in testing, and this is the usual issue I've encountered from Appium. An additional feature I'd like added to Appium in its next release is being able to do automation in iOS without using XPath and the name of the element. In Xcode, you can use previous UI tests for detecting elements, but in Appium, you have to use Xpath and the element name instead of being able to directly put the X-UiPath, which is what you can do in Xcode. In iOS as well, sometimes the element doesn't have a name or a path. Sometimes, there's also no element."
"We haven't been able to fully leverage Appium for multiple reasons. I think number one is just that the tests take a long time to run. We have had some issues around just the results themselves and how predictable they are, but those are not issues with Appium directly."
"Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"Increased performance with less memory and CPU usage."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"The initial setup of SmartBear TestComplete was complex."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"What is currently missing from this solution is better support for mobile testing."
Appium is ranked 5th in Regression Testing Tools with 25 reviews while SmartBear TestComplete is ranked 6th in Regression Testing Tools with 71 reviews. Appium is rated 8.0, while SmartBear TestComplete is rated 7.6. The top reviewer of Appium writes "It's easy to launch applications". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Appium is most compared with Tricentis Tosca, Katalon Studio, Perfecto, Xamarin Platform and Eggplant Performance, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and LEAPWORK. See our Appium vs. SmartBear TestComplete report.
See our list of best Regression Testing Tools vendors.
We monitor all Regression Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.