Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Appium comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
92
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
Appium
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
30
Ranking in other categories
Mobile Development Platforms (7th), Regression Testing Tools (6th)
 

Mindshare comparison

Apache JMeter and Appium aren’t in the same category and serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 24.4%, up 22.6% compared to last year.
Appium, on the other hand, focuses on Mobile Development Platforms, holds 5.3% mindshare, down 7.9% since last year.
Performance Testing Tools
Mobile Development Platforms
 

Featured Reviews

Sreenivasula Mukkamalla - PeerSpot reviewer
Leveraging cost-effective customization with powerful plugins but complexity reduction needed
Apache JMeter offers plugins for reporting and preparing test scenarios. It allows recording to customization, letting you download plugins to connect with databases or external systems. Despite being open source, it offers features comparable to paid tools, and its ability to customize and expand is particularly useful. Additionally, its open-source nature makes it cost-effective.
Abhishek-Tiwari - PeerSpot reviewer
Has cross-platform flexibility and a record-and-play option
The challenging part with Appium is that installation can be a bit tricky. It can be challenging to set up in Android versus iOS environments. Appium has some limitations in terms of writing code using simulators and online cloud devices. I faced challenges with native based scenarios, battery turn out percentage, battery charging percentage, and memory capacity. The other challenge I faced involved codes changing from device to device. For example, the piece of code that works in iOS version 10.1 won't work in iOS version 6.0. In upcoming releases, if they can reduce some more of the dependencies like SDK, UIAutomator, etc., it would be great. That is, I'd like to see a consolidated package or bundle release that is much more user-friendly.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The product helps me get the expected performance from applications or servers and reduces costs. It also enhances the performance of the services and helped them reach their ultimate capacity."
"We use Apache JMeter for load testing, where we provide the throughput time."
"This solution is very user-friendly, and allows for a lot of data capture when testing."
"It is open source as well as relatively extendable. It allows us to extend and add additional functionality and features. Its deployment is also very easy."
"The metrics part of it and the ability to write your custom code to do some specific tests in the performance testing space are the most valuable features."
"This solution is easier to use than any other tool in the market; there is not even a requirement to learn a lot of scripting in order to use it."
"JMeter is a free tool with a large user population, which comes in handy because we have a vast knowledge base to tap into when needed. It's also easier to hire consultants who know JMeter."
"Any front-end technologies like Angular, React, or others might access the services. Therefore, you must ensure that using SAP with JMeter works fine. Unless you ensure this, the front-end team may not access the services properly."
"It runs completely flawlessly and seamlessly every day."
"The most valuable feature of Appium is it supports iOS and AOS and is open-source."
"The library is extensive so the driver interacts with most functions or actions on mobile devices."
"The latest versions of the solution are stable."
"The solution is stable."
"The most valuable features of Appium are the in-built functionality, which we can use in our code. For example, move back, move front, navigate one page before, and navigate one page ahead. You can do this by using the in-built functions from Appium."
"The way Appium server interacts with mobile apps is fantastic. It provides all the information about the elements inside the app, Android as well as iOS. I can interact with the element quickly, just type some text or get some text values from the element - whether it's a drop-down, or web text, or a native element."
"Appium helps me to do as much as much as I want to."
 

Cons

"If JMeter could integrate with the EPM solution, it would be great. It could also be improved by offering more integrations for security. For example, most applications are secure with OpenID Connect protocols."
"There is some work to be done with the integration."
"Report generation needs to be improved. It is quite difficult to get to."
"Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."
"The solution is not user-friendly, there is no framework for autocorrelation or parameterization."
"Documentation is not comprehensive, making it difficult to find the right answers."
"The solution needs to improve reporting. Currently, there is not enough automation involved with the feature. For example, there should be an automatic way of saving reports."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"We haven't been able to fully leverage Appium for multiple reasons. I think number one is just that the tests take a long time to run. We have had some issues around just the results themselves and how predictable they are, but those are not issues with Appium directly."
"Configuration-wise, there is a lot of room for improvement."
"The challenging part with Appium is that installation can be a bit tricky. It can be challenging to set up in Android versus iOS environments."
"Stability is an area that needs some improvement."
"Configuring the project to be used in Appium is a little bit tedious."
"One thing which can be really helpful is that there is some kind of a recorder made available rather than scripting everything."
"There is always a concern about the amount of code that is required to enhance the automation process. The idea of having less code or no code is what we would like to see in future updates."
"Image recognition could be improved. We have some images in our mobile applications. It should be able to run from the cloud, so we can automate the catcher."
 

Pricing and Cost Advice

"I was using the free version of the software."
"JMeter is open source, so there are no licensing costs associated with it."
"We are using the free version, and if required, we can easily switch to the other version."
"This is an open-source solution, so there are no licensing costs associated with it."
"Apache JMeter is a free tool."
"The price of Apache JMeter is good. The selling rate is quite effective and the limited users with a multi-region-related execution."
"The solution is open source."
"Since we are using an outsourced solution, it is not paid for by our company."
"Appian is open-source, which is not licensed."
"The price is good for people to be able to make a favorable decision for the value."
"Appium is open source; we can use it for free."
"The solution is open source."
"This is an open source solution so it does not cost anything for licensing or otherwise."
"There is no license for this solution because it is open-source."
"The solution is free."
"Appium is free and open-source."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
831,265 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
16%
Manufacturing Company
8%
Government
7%
Financial Services Firm
20%
Computer Software Company
15%
Manufacturing Company
7%
Insurance Company
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
Do you recommend Appium?
I do recommend Appium. It is an open-source solution and completely free of charge. We use Appium and Appium Studio as our base for any type of mobile automation for testing. It has a great interfa...
What do you like most about Appium?
Appium helps me to do as much as much as I want to.
What is your experience regarding pricing and costs for Appium?
My experience with Appium from a pricing perspective is favorable due to it being open source, making it a cost-effective option.
 

Comparisons

 

Also Known As

JMeter
No data available
 

Learn More

 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Nuvizz, Coupa Software, Eventbrite, Evernote
Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools. Updated: January 2025.
831,265 professionals have used our research since 2012.