Appium Reviews

We use this solution for mobile UI automation, and particularly for regression test automation.

We develop complete, end to end test cases, then we automate them and run those test cases in a DevOps process. It's a complete CICD (continuous integration, continuous development) using DevOps methodology.

Our automation job triggers immediately after a successful development build. Upon completion of automated test cases, results are emailed to all stakeholders. This is a completely automated process without any manual intervention.

This solution has improved our organization in terms of efficiency. We use this tool for one of our mobile applications that supports iOS and Android devices. The application should support all Android devices with OS version 6 and above, whereas the iOS application should be compatible with iOS 9.3 and up. Therefore, it supports multiple OS versions with all of the devices and handsets that are coming to the market.

It becomes very difficult for our regulation team to test the solution, or run their test cases, on all of these platforms and mobile devices. But, with the help of automation, we can create a single script that does so. Not only that, but we can run our tests in a 24/7 model that includes weekends. Our team members cannot work overnight or on the weekend.

This solution continuously generates reports, and the report is the only thing that needs to be analyzed by the testing team. It runs completely flawlessly and seamlessly every day. This makes it very cost effective and productive. That is one of the major benefits for us.

Appium is a very good tool because with its help we can automate all of the platforms, Android, iOS, or Windows, and there is a single solution. We can create a single framework for all platforms that can satisfy all of the needs. Being an open source solution it is free of cost.

Otherwise, there are other open source tools for particular platforms, but with the Appium library, we can automate all major platforms.

This product is still maturing, so at times there are issues with its stability if your scripts run continuously for more than fifteen to twenty hours. At times, we have witnessed the Appium server stop responding for forty to forty-five minutes. As a result, scripts do not move in this time period. Sometimes the connection resets due to USB or Network issues, which is not an Appium issue.

There is no user interface because it is a complete development solution, and you have to code in Java. I do not see any room to include an interface in the near future, as is the case with other commercial automation tools.

For iOS automation, it is very tedious to install or configure this particular library in your system, and it becomes very difficult to troubleshoot if you are not Mac and Xcode savvy. You require an understanding of the configuration of Xcode projects and you have to troubleshoot a lot of things at times. 

Configuration/Installation-wise, there is a lot of room for improvement in this solution, especially for the iOS platform.

Stability-wise, this tool is still maturing. I have seen improvement over the past two years, with every release. I expect that in another year it will be even more stable.

In our experience, if you are running smaller scripts that execute for two or three hours, then this tool is good enough. If, however, your scripts run continuously for twenty or twenty-four hours then the tool give you issues at times. The connection gets reset or the server hangs in between. These things are normally seen after ten or eleven hours.

In terms of scalability, this tool is doing well. We have automated more than five hundred test cases, which run for twenty to twenty-two hours in one go. In that way, it is doing well, although, sometimes there are cases where the Appium server hangs, and the script does not proceed forward. This has to be ironed out.

We do plan to increase the usage of this solution. Right now, our company has a lot of experience and a lot of people are learning this tool, as well as other open source solutions. We do not use any commercial products. In fact, we have a policy of using open source solutions, as they are in demand. There is nothing challenging the capability of this tool right now.

Being an open source project, there is no company that specifically supports this tool.

That said, the open source community is quite strong. If you are having any kind of issues, with your solution or your implementation, there are multiple points that are available and you can ask questions. Most of the time you get your resolution in a very quick time, maybe in a day or sometimes a couple of days. In fact, most of the time, with my experience I can say 95% to 98% of the time, I found a solution which helped us. 

The open source community includes a large user base who are actively using it and sharing their experience, as well as their implementation solutions, over the net. 

Before this solution, I only had experience with HPE UFT (Unified functional testing). I, later on, moved to Selenium because we are able to achieve the same results with this open source solution as with any other commercial product, without any one-time or recurring cost for the tool. 

Selenium has matured with time and become a stable solution for Web Application automation. More and more clients are preferring Selenium because of the no-cost factor, and as a result, there are good job opportunities available for people who can work on Selenium. 

These were the major driving forces for me to move towards the Selenium automation solution.

Installation of this particular tool is tedious, and it gives you a good number of challenges at times. You have to resolve them, troubleshoot them every now and then, and you need the right people. You need a good expert with experience who can help you. It is not possible for a novice user, or any user who is new to the team, to do all of these things. There is a steep learning curve.

In order to use this tool for iOS applications, you have to use Xcode and have to install and create profiling for your development solution. For a user who is new to the system, and perhaps not aware of Xcode or profile creation on a Mac machine, it becomes difficult. The majority of developers use Windows-based development systems. In order to automate iOS applications, we have to use Mac-based machines to provide the operating system.

This means that you need to have some kind of experience with Xcode, or at least some experience with iOS application configuration. These are the skills required in order to set Appium up on your Mac machine and use iOS automation.

A Windows-based system can be used for Android applications, but a Mac machine can be used for both iOS and Android. I rely on Windows for Android, but you are certainly free to work on a Mac machine.

There are six people in our team using this solution on all platforms. I have the role of Automation Architect, and the others are Automation Engineers. We have set up a local cloud environment in our office, and we do everything ourselves.

We deployed this solution ourselves and created our own script for Appium installation on an iOS machine. Instead of individual commands, we have created a BASH script which installs & configures the automation development environment. With this, it is easy to install and configure a system for a new developer who is coming to our team. If you do not have such a script then it is a full-day task to complete the setup and configuration on your iOS machine.

This is an open source solution so it does not cost anything for licensing or otherwise.

I had evaluated SeeTest before Appium for mobile solution development, but the customer was not willing to invest in a commercial tool. SeeTest is more stable, mature, and easy to install as compared to Appium, but it comes with a significant cost of almost $80,000 per year (number of licenses that we required). This is the reason we decided to move on with Appium.

This solution is one that you need a little bit of time and patience to learn, but once you learn it, it opens the gate to work on many other similar types of tools or wrappers that are created, keeping Selenium at the core. 

Overall, the product is good. On a scale of one to ten, I am only deducting two points because you cannot automate & run the iOS application on the Windows OS. You require Mac machines for iOS automation. Also, installation and configuration are also tedious for new users.

I would rate this solution eight out of ten.

Support for both Android and IOS. It simplifies the testing setup.

It saves a large amount of QA resources needed for doing smoke tests and sanity checks on new versions of the app on several phones and OS versions.

Usability. The documentation is not always easy to follow, especially the advanced setup part, where the IOS predicates usage. Also, the Appium inspector, a tool which allows you to inspect screen elements, is rather tricky to setup.

Three years.

Yes. Sometimes the mobile environment reset and application installation are slow. Sometimes you need to kill and restart the Appium app. I have seen constant improvements though.

Appium is not that scalable, if you're using real devices locally. It can get scalable by using cloud services and emulators.

I am not aware of any paid support option. There is a decent sized community where you can get answers. Also, Appium and all language extension clients are open-source, so anybody can raise issues on Github.

Yes, Silk Mobile. Its features are very far from Appium's capabilities. Also, it is expensive.

Straightforward. Straightforward on Windows, relatively straightforward on MAC (the best option is testing on both Android and IOS devices), slightly tricky on Linux (I am using Arch Linux).

It's open source. There is nothing wrong with that.

I was using Silk Mobile, and it was not the right tool for our needs. Also, I tested the native automation on both Android and Mac. These are good options, but you need to switch context radically from Android to IOS and back.

Good luck, not sure how you can do it better. It has flaws, but is still much better than any other cross-platform mobile automation tool.

I use Appium to develop automation scripts for our mobile applications for iOS and Android and test client applications for our FinTech client.

Appium's best feature is that it supports multiple frameworks.

Appium has problems with automated validations following iOS updates, causing us to have to validate manually. Its execution speed is also very slow.

I've been using Appium for more than seven years.

Appium is scalable.

Appium's support forum is very helpful.

Appium is free and open-source.

I would give Appium a rating of seven out of ten.

We are a consulting company. Appium is an open-source library. We use Appium in our platform for optimizing mobile testing. For our company, Appium's similarity with Selenium is important as we use Selenium.

We have three users using this solution.

I find the configuration and interface of Appium valuable. Appium has easy interaction with mobile.

When doing mobile testing Appium is difficult as you can't use it for mobile testing in virtual machines. You need to have a physical machine. If Appium could manage this problem, and if it had more facility for configuration it would be a spectacular solution.

We have been using Appium for two years.

Technical support has been fine.

Appium is not easy to setup, it has a degree of complexity. 

The pricing of Appium is fine.

We evaluated Micro Focus.

I would rate this solution an 8 out of 10.

- Best part is that it's open source tool.

- Supports multiple mobile platforms.

- It supports native apps, mobile web & hybrid applications of both Android and iOS.

- It is based on Selenium using HTTP protocols.

- It supports most of the scripting languages like Java, Ruby, Java script, etc.

- It can be integrated with CI tools.

It is an indispensable tool for mobile automation helps much in converting manual test cases to automated scripts. Being an open source tool, it yields good ROI.

It should provide reliable & promising executions every time without any interruptions and avoiding any synchronization issues. They should also think of supporting Windows mobile applications as well in future.

The highest strength of this tool is that it's open source.