Try our new research platform with insights from 80,000+ expert users

AWS Device Farm vs Ranorex Studio comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Mar 4, 2025

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

AWS Device Farm
Ranking in Mobile App Testing Tools
6th
Average Rating
6.6
Reviews Sentiment
6.6
Number of Reviews
2
Ranking in other categories
No ranking in other categories
Ranorex Studio
Ranking in Mobile App Testing Tools
4th
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
46
Ranking in other categories
Functional Testing Tools (14th), Regression Testing Tools (7th), Test Automation Tools (11th)
 

Mindshare comparison

As of April 2025, in the Mobile App Testing Tools category, the mindshare of AWS Device Farm is 2.1%, down from 5.6% compared to the previous year. The mindshare of Ranorex Studio is 8.9%, up from 8.4% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Mobile App Testing Tools
 

Featured Reviews

AshishSingh11 - PeerSpot reviewer
A stable solution used for malware testing and APM that needs to improve its performance
The setup phase was fine because AWS had given the whole tree structure on their website. So, basically, if we go here and there apart from that tree structure, it does not support it. So they have a very sophisticated tree structure. So that is the only tree structure that we have to follow. Else, there will be problems. I rate the setup process a seven out of ten, with ten being the easiest setup. Since I had to study the solution, it took me a week to properly deploy it. I just followed the instructions given by AWS to deploy the solution. So on their website, whatever the steps they had given, I simply kept on following it.
Aws V - PeerSpot reviewer
Good data security, allowing local installations to prevent data from going to the internet
There were a lot of issues we faced. One notable improvement would be better API integration within the tool itself, as we still rely on external tools like Postman. Additionally, expanding language support beyond C#, Java, and JavaScript to include Python would be beneficial. An AI feature that automatically detects automation object properties and suggests actions would be a great addition. So, in future releases, AI solutions for automated property identification would be helpful.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"I rate the stability an eight out of ten."
"What I like best about AWS Device Farm is that it offers actual physical devices that let you do more accurate testing because physical devices depict the live testing scenarios much better as opposed to emulated devices. AWS Device Farm is a pretty nice solution. Because it's an AWS service, you can use the CLI to tie in several steps that can create the pipeline, and run it efficiently. AWS Device Farm also gives you monitoring ability, observability, logging, etc., so I'm pretty satisfied with the solution."
"The solution is stable."
"The solution is fast and includes built-in libraries that record and playback."
"This is a powerful, reliable and versatile all-around application testing suite."
"The scalability is very good. It's probably one of the better tools I've seen on the market."
"Object identification is good."
"Code Conversion is one of the great features because sometimes, the automation tool doesn't have the capability of maneuvering around two specific evaluations."
"The solutions's regression testing is very important for our company, as is the continuous integration process."
"I like the recording function and Ranorex Spy."
 

Cons

"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services. The solution doesn't have great connectivity with other services offered by AWS, for example, AWS Secrets Manager. This should be improved because a lot of times, that missing functionality hampers the quality and engineering standards in terms of deploying the full AWS suite of services. What I'd like to see in the next version of AWS Device Farm is for it to link better, or have some type of enrollment that would tie it in with other AWS services, such as EventBridge, Lambda, Secrets Manager, and any other new service from AWS."
"It is slow. It is super slow. Performance is an area that can be improved."
"Ranorex is used in Windows while other solutions, for example, Katalon Studio, are cross-platform. (But in my opinion, overall, Ranorex is better)."
"If there are many queries on the web page, Ranorex will not render the page correctly. I had about 1,000 queries on the page, and the solution was not able to handle it."
"Binding to other sources is very good but the object recognition in .NET desktop applications often doesn't work."
"The solution's technical support team could be responsive."
"I would like to be able to customize the data grids. They are currently written in Visual Basic and we are unable to get down to the cell level without hard-code."
"I'd like to know their testing strategies and to know what they can automate and what they can't. It can become pretty frustrating if you're trying to automate something that changes on a monthly or weekly basis."
"The object detection functionality needs to be improved."
"Other OS Support, Ranorex Spy performance improvement (Especially for Silverlight controls)."
 

Pricing and Cost Advice

"AWS Device Farm is an expensive service overall. You pay per device, and the cost for each device isn't cheap. My company paid for a device slot. It's a yearly subscription for a single device slot, so that's more cost-effective for my company. On a scale of one to five, where one is very expensive and five is very cheap, I'd give AWS Device Farm a two. It's on the more expensive side."
"Our company has one license per user with each costing two lakh rupees."
"There are several types of licenses and you need to choose depending on your needs and level of usage."
"This solution is a more expensive solution compared to some of the other competitors."
"The licensing fees depend on the number of users."
"Licensing fees are paid on a yearly basis."
"We paid €3,000 (approximately $3,300 USD) for this solution. When you add the runtime licenses it will be €3,500 (approximately $3,900 USD)."
report
Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.
845,849 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
27%
Computer Software Company
11%
Manufacturing Company
8%
Insurance Company
8%
Computer Software Company
20%
Manufacturing Company
13%
Financial Services Firm
10%
Government
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What do you like most about AWS Device Farm?
I rate the stability an eight out of ten.
What needs improvement with AWS Device Farm?
It is slow. It is super slow. Performance is an area that can be improved. Whenever we upload our Zip files to that particular platform, you know, it takes quite some time, especially if the file i...
What is your primary use case for AWS Device Farm?
We have used the solution for malware testing and APM.
What do you like most about Ranorex Studio?
Data security was prime for us. Being able to download and run tests on our local machines was a big plus. The flexibility Ranorex offers in terms of customization is outstanding.
What is your experience regarding pricing and costs for Ranorex Studio?
I'd rate it around five out of ten, where one is cheap and ten is expensive, not too cheap but not overly pricey.
What needs improvement with Ranorex Studio?
There were a lot of issues we faced. One notable improvement would be better API integration within the tool itself, as we still rely on external tools like Postman. Additionally, expanding languag...
 

Overview

 

Sample Customers

NFL, Etsy, Tableau, Gannett, Miniclip, Allstate, Rainforest, goibibo, mysmartprice, Zillow
Siemens, TomTom, Adidas, Canon, Lufthansa, Roche, Cisco, Philipps, Dell, Motorola, Toshiba, Citrix, Ericsson, sage, Continental, IBM, Credit Suisse, Vodafone
Find out what your peers are saying about AWS Device Farm vs. Ranorex Studio and other solutions. Updated: March 2025.
845,849 professionals have used our research since 2012.