Try our new research platform with insights from 80,000+ expert users

AWS Device Farm vs SmartBear TestComplete Mobile comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

AWS Device Farm
Ranking in Mobile App Testing Tools
5th
Average Rating
6.6
Number of Reviews
2
Ranking in other categories
No ranking in other categories
SmartBear TestComplete Mobile
Ranking in Mobile App Testing Tools
13th
Average Rating
8.0
Number of Reviews
2
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of November 2024, in the Mobile App Testing Tools category, the mindshare of AWS Device Farm is 4.2%, down from 6.8% compared to the previous year. The mindshare of SmartBear TestComplete Mobile is 0.4%, down from 0.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Mobile App Testing Tools
 

Featured Reviews

AshishSingh11 - PeerSpot reviewer
Jun 2, 2023
A stable solution used for malware testing and APM that needs to improve its performance
The setup phase was fine because AWS had given the whole tree structure on their website. So, basically, if we go here and there apart from that tree structure, it does not support it. So they have a very sophisticated tree structure. So that is the only tree structure that we have to follow. Else, there will be problems. I rate the setup process a seven out of ten, with ten being the easiest setup. Since I had to study the solution, it took me a week to properly deploy it. I just followed the instructions given by AWS to deploy the solution. So on their website, whatever the steps they had given, I simply kept on following it.
it_user1301076 - PeerSpot reviewer
Apr 3, 2020
We are facing sometimes the situation when we have some issues with our automated tests.
I like that it offers internal methods for supported controls. It is very easy to code the tests. Object Spy is also a good feature. The mapping is pretty complicated because there are a lot of controls that are the same and if you have a long name with the object mapping it is easy to get confused. TestComplete is perfect if you have an automation ID or something unique to each controller. Unfortunately our developers said that it's very hard to maintain all the names and automation IDs. Maybe in the future with this mapping part would be better.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"What I like best about AWS Device Farm is that it offers actual physical devices that let you do more accurate testing because physical devices depict the live testing scenarios much better as opposed to emulated devices. AWS Device Farm is a pretty nice solution. Because it's an AWS service, you can use the CLI to tie in several steps that can create the pipeline, and run it efficiently. AWS Device Farm also gives you monitoring ability, observability, logging, etc., so I'm pretty satisfied with the solution."
"I rate the stability an eight out of ten."
"I like that it offers internal methods for supported controls. It is very easy to code the tests. Object Spy is also a good feature."
"The features I find most valuable is the automatic remapping of aliases, because it is really helpful."
 

Cons

"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services. The solution doesn't have great connectivity with other services offered by AWS, for example, AWS Secrets Manager. This should be improved because a lot of times, that missing functionality hampers the quality and engineering standards in terms of deploying the full AWS suite of services. What I'd like to see in the next version of AWS Device Farm is for it to link better, or have some type of enrollment that would tie it in with other AWS services, such as EventBridge, Lambda, Secrets Manager, and any other new service from AWS."
"It is slow. It is super slow. Performance is an area that can be improved."
"The mapping is pretty complicated because there are a lot of controls that are the same and if you have a long name with the object mapping it is easy to get confused."
"It is very difficult to use the aliases on old software."
 

Pricing and Cost Advice

"AWS Device Farm is an expensive service overall. You pay per device, and the cost for each device isn't cheap. My company paid for a device slot. It's a yearly subscription for a single device slot, so that's more cost-effective for my company. On a scale of one to five, where one is very expensive and five is very cheap, I'd give AWS Device Farm a two. It's on the more expensive side."
Information not available
report
Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.
814,763 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
22%
Computer Software Company
14%
Insurance Company
8%
Manufacturing Company
8%
No data available
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
No data available
 

Questions from the Community

What do you like most about AWS Device Farm?
I rate the stability an eight out of ten.
What needs improvement with AWS Device Farm?
It is slow. It is super slow. Performance is an area that can be improved. Whenever we upload our Zip files to that particular platform, you know, it takes quite some time, especially if the file i...
What is your primary use case for AWS Device Farm?
We have used the solution for malware testing and APM.
Ask a question
Earn 20 points
 

Comparisons

 

Overview

 

Sample Customers

NFL, Etsy, Tableau, Gannett, Miniclip, Allstate, Rainforest, goibibo, mysmartprice, Zillow
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit
Find out what your peers are saying about AWS Device Farm vs. SmartBear TestComplete Mobile and other solutions. Updated: October 2024.
814,763 professionals have used our research since 2012.