Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Appium comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
93
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
Appium
Average Rating
8.0
Reviews Sentiment
7.4
Number of Reviews
30
Ranking in other categories
Mobile Development Platforms (6th), Regression Testing Tools (6th)
 

Mindshare comparison

Apache JMeter and Appium aren’t in the same category and serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 24.0%, up 23.9% compared to last year.
Appium, on the other hand, focuses on Mobile Development Platforms, holds 4.4% mindshare, down 7.6% since last year.
Performance Testing Tools
Mobile Development Platforms
 

Featured Reviews

Sreenivasula Mukkamalla - PeerSpot reviewer
Leveraging cost-effective customization with powerful plugins but complexity reduction needed
Apache JMeter offers plugins for reporting and preparing test scenarios. It allows recording to customization, letting you download plugins to connect with databases or external systems. Despite being open source, it offers features comparable to paid tools, and its ability to customize and expand is particularly useful. Additionally, its open-source nature makes it cost-effective.
Abhishek-Tiwari - PeerSpot reviewer
Has cross-platform flexibility and a record-and-play option
The challenging part with Appium is that installation can be a bit tricky. It can be challenging to set up in Android versus iOS environments. Appium has some limitations in terms of writing code using simulators and online cloud devices. I faced challenges with native based scenarios, battery turn out percentage, battery charging percentage, and memory capacity. The other challenge I faced involved codes changing from device to device. For example, the piece of code that works in iOS version 10.1 won't work in iOS version 6.0. In upcoming releases, if they can reduce some more of the dependencies like SDK, UIAutomator, etc., it would be great. That is, I'd like to see a consolidated package or bundle release that is much more user-friendly.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It is cost-effective and simple to use."
"It is easy to set up."
"To me, what's most valuable in Apache JMeter is that it's a lightweight tool for application testing. It's the best load-testing tool for my company because Apache JMeter simulates your application during testing. Apache JMeter also creates threads with good server utilization. Apache JMeter allows you to focus on analyzing the situation, looking into measurements, response time, and client-server responses, which I find valuable."
"We like that Apache JMeter has different features and different plugins and that they are free of charge."
"We find the ease of use and the reports and graphs available valuable."
"It is scalable. You can scale up to 1,000 users in JMeter. If you can put up four slave servers, you can easily ramp up to 1,000 users."
"Any front-end technologies like Angular, React, or others might access the services. Therefore, you must ensure that using SAP with JMeter works fine. Unless you ensure this, the front-end team may not access the services properly."
"Monetary benefits with Apache JMeter are notable since it doesn’t require a licensed version."
"It's an open-source solution with a very large community and available documentation."
"Obviously because of automation, it reduces manual testing efforts."
"Appium helps me to do as much as much as I want to."
"The way Appium server interacts with mobile apps is fantastic. It provides all the information about the elements inside the app, Android as well as iOS. I can interact with the element quickly, just type some text or get some text values from the element - whether it's a drop-down, or web text, or a native element."
"The most valuable features of Appium are the in-built functionality, which we can use in our code. For example, move back, move front, navigate one page before, and navigate one page ahead. You can do this by using the in-built functions from Appium."
"The library is extensive so the driver interacts with most functions or actions on mobile devices."
"I haven't explored other solutions in this particular area, but what I like best about Appium is the fact that it shares functions with Selenium. The extension of Selenium functions allows me to use all of the methods that exist in that domain, and it just makes it simpler for me. I've been using Selenium for some time as well, so using Appium just seems like a natural fit for me."
"The best feature of Appium is that it allows you to inspect the element. With the Appium Inspector, you don't have to install another application to do the inspection. I also like that Appium has Android device connectivity. Currently, most people use Appium as automation software, and I haven't found any other tool that's more powerful than Appium."
 

Cons

"The UI of the solution needs to be better. The UI takes up a lot of our bandwidth."
"Improving JMeter's sync time would be beneficial."
"Some features still require a certain knowledge level to use effectively, and making these features more user-friendly would be beneficial."
"Running JMeter in GUI mode uses a lot of memory, which means we need to switch to a non-GUI mode when using a heavy load."
"We would like more documentation to be provided for the advanced level features that are available in this solution, in order to improve development."
"Self-healing and page rendering for the end-users are not available in Apache JMeter."
"It's not easy to get the data from one place or to do customizations."
"JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases."
"They should add an in-built framework."
"The installation part of Appium is somewhat clumsy, requiring numerous dependencies and configurations."
"There is always a concern about the amount of code that is required to enhance the automation process. The idea of having less code or no code is what we would like to see in future updates."
"The deployment process and configuration are quite complex and require improvement."
"The tool needs to add a dependency manager."
"One area where I think Appium could improve is in addressing security concerns for our data. Currently, we're unable to use cloud solutions like CloudForm due to security restrictions on our servers. We also face challenges in updating packages for the same reason. It would be beneficial if the solution could provide better support for auto-reporting and easier connections to mobile device farms."
"An application developed on the Unity platform, such as a gaming application, objects are moving in that case. Interacting with those elements is still lacking in Appium. Appium doesn't have the internal library to play with the Unity platform. That is a huge lack right now."
"Appium can improve when the case fails, there should be a feature where you can generate the report from Appium. Once you're on a test case, automatically the screenshot should be captured which would avoid manual intervention. These features would be beneficial to migrate to Appium."
 

Pricing and Cost Advice

"The solution is open source with no user fees or licenses."
"When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
"There are operational costs related to using Amazon Cloud, but the tool itself."
"Since it is an open-source product, buying or paying for any license is unnecessary. One just needs to download it to be able to use it."
"Since we are using an outsourced solution, it is not paid for by our company."
"The tool is open-source."
"Since it's free, there's no need for extensive support or improvements in pricing."
"Free"
"The solution is free."
"We found out that we could explore features of the solution for 30 days trial. We can switch to a permanent license later if we want."
"The pricing of Appium is fine."
"The solution is open source so it is free."
"This is an open source solution so it does not cost anything for licensing or otherwise."
"I'm unsure if there's any cost associated with Appium. I got the free package which includes the server GUI application and the inspector application, and it was free to download, and that's all I need to get my work done. I'm not aware of any additional costs associated with the tool."
"It's open source, so it's completely free."
"Appian is open-source, which is not licensed."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
848,716 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
20%
Computer Software Company
16%
Manufacturing Company
7%
Government
7%
Financial Services Firm
20%
Computer Software Company
15%
Manufacturing Company
7%
Retailer
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
Do you recommend Appium?
I do recommend Appium. It is an open-source solution and completely free of charge. We use Appium and Appium Studio as our base for any type of mobile automation for testing. It has a great interfa...
What do you like most about Appium?
Appium helps me to do as much as much as I want to.
What is your experience regarding pricing and costs for Appium?
My experience with Appium from a pricing perspective is favorable due to it being open source, making it a cost-effective option.
 

Comparisons

 

Also Known As

JMeter
No data available
 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Nuvizz, Coupa Software, Eventbrite, Evernote
Find out what your peers are saying about Apache, Tricentis, Perforce and others in Performance Testing Tools. Updated: March 2025.
848,716 professionals have used our research since 2012.