Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Appium comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
93
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
Appium
Average Rating
8.0
Reviews Sentiment
7.4
Number of Reviews
30
Ranking in other categories
Mobile Development Platforms (6th), Regression Testing Tools (6th)
 

Mindshare comparison

Apache JMeter and Appium aren’t in the same category and serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 24.1%, up 23.4% compared to last year.
Appium, on the other hand, focuses on Mobile Development Platforms, holds 4.9% mindshare, down 7.6% since last year.
Performance Testing Tools
Mobile Development Platforms
 

Featured Reviews

Sreenivasula Mukkamalla - PeerSpot reviewer
Leveraging cost-effective customization with powerful plugins but complexity reduction needed
Apache JMeter offers plugins for reporting and preparing test scenarios. It allows recording to customization, letting you download plugins to connect with databases or external systems. Despite being open source, it offers features comparable to paid tools, and its ability to customize and expand is particularly useful. Additionally, its open-source nature makes it cost-effective.
Abhishek-Tiwari - PeerSpot reviewer
Has cross-platform flexibility and a record-and-play option
The challenging part with Appium is that installation can be a bit tricky. It can be challenging to set up in Android versus iOS environments. Appium has some limitations in terms of writing code using simulators and online cloud devices. I faced challenges with native based scenarios, battery turn out percentage, battery charging percentage, and memory capacity. The other challenge I faced involved codes changing from device to device. For example, the piece of code that works in iOS version 10.1 won't work in iOS version 6.0. In upcoming releases, if they can reduce some more of the dependencies like SDK, UIAutomator, etc., it would be great. That is, I'd like to see a consolidated package or bundle release that is much more user-friendly.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good."
"What I like best about Apache JMeter is its user-friendly GUI because even if you don't have very good coding knowledge or understanding, or even if you don't come from a development background, you can still use the solution with just a few clicks. This is what's unique about Apache JMeter, in comparison with other tools in the market. As Apache JMeter is open source, when there's a missing feature, you can search in several community blogs for plugins that you can use to modify Apache JMeter to meet your requirements, and this is another advantage."
"We appreciate that the solution is free to use, as an open-source tool."
"Scripting with the solution is good."
"It's open source, so I like that about the product. And there's a lot of community support for it."
"Overall, I would rate Apache JMeter as eight to nine out of ten."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"I like the fact that JMeter integrates well with other tools."
"The most valuable feature of Appium is it supports iOS and AOS and is open-source."
"It has great documentation and excellent community support."
"Appium provides a record-and-play option, and the commands are the same as those that Selenium uses. So a person who has some exposure to Selenium will be able to write a piece of code in Appium."
"I haven't explored other solutions in this particular area, but what I like best about Appium is the fact that it shares functions with Selenium. The extension of Selenium functions allows me to use all of the methods that exist in that domain, and it just makes it simpler for me. I've been using Selenium for some time as well, so using Appium just seems like a natural fit for me."
"Appium's best feature is that it supports multiple frameworks."
"It's an open-source solution with a very large community and available documentation."
"Obviously because of automation, it reduces manual testing efforts."
"Appium helps me to do as much as much as I want to."
 

Cons

"What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter."
"Apache JMeter could use improvement in reporting. Currently, it isn't easy to generate reports in PDF format. While receiving reports in PDF format is possible, it requires a lot of customization. Additionally, when comparing the load test to others solutions it could improve."
"We would like some reporting and analysis tools to be added to this solution."
"Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script."
"If JMeter could provide a web version of editing, that would be good."
"From an improvement perspective, consider a scenario where your application needs to retrieve data from PayPal and store it in an Excel file in an external network."
"The solution's setup could be easier and security could be improved to minimize vulnerabilities."
"JMeter is lagging when it comes to GUI performance testing because we need to install some third-party plugins for recording the GUI script, and the performance isn't very reliable."
"Appium can improve when the case fails, there should be a feature where you can generate the report from Appium. Once you're on a test case, automatically the screenshot should be captured which would avoid manual intervention. These features would be beneficial to migrate to Appium."
"Appium has problems with automated validations following iOS updates, causing us to have to validate manually."
"Configuration-wise, there is a lot of room for improvement."
"They should add an in-built framework."
"Support-wise, it could be better."
"Appium could improve by enabling record and run techniques similar to what they have in other licensing tools, such as Micro Focus. We have to all write the code, and then we can proceed."
"The deployment process and configuration are quite complex and require improvement."
"If it had more facility for configuration it would be a spectacular solution."
 

Pricing and Cost Advice

"Apache JMeter is a free, open-source solution."
"No licensing is required as it is a free, open-source tool."
"I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
"JMeter is open source and available free of charge."
"I was using the free version of the software."
"We didn't pay licensing fees for Apache JMeter because it's an open-source tool. We only paid for the machines where we installed Apache JMeter modules."
"Apache JMeter is an open-source solution, so it's free to use."
"It is free."
"Appian is open-source, which is not licensed."
"The price is good for people to be able to make a favorable decision for the value."
"There is no license for this solution because it is open-source."
"The solution is free."
"Appium is open source; we can use it for free."
"We found out that we could explore features of the solution for 30 days trial. We can switch to a permanent license later if we want."
"I'm unsure if there's any cost associated with Appium. I got the free package which includes the server GUI application and the inspector application, and it was free to download, and that's all I need to get my work done. I'm not aware of any additional costs associated with the tool."
"The solution is open-source."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
842,592 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
20%
Computer Software Company
16%
Manufacturing Company
7%
Government
7%
Financial Services Firm
19%
Computer Software Company
15%
Manufacturing Company
8%
Retailer
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
Do you recommend Appium?
I do recommend Appium. It is an open-source solution and completely free of charge. We use Appium and Appium Studio as our base for any type of mobile automation for testing. It has a great interfa...
What do you like most about Appium?
Appium helps me to do as much as much as I want to.
What is your experience regarding pricing and costs for Appium?
My experience with Appium from a pricing perspective is favorable due to it being open source, making it a cost-effective option.
 

Comparisons

 

Also Known As

JMeter
No data available
 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Nuvizz, Coupa Software, Eventbrite, Evernote
Find out what your peers are saying about Apache, Tricentis, Perforce and others in Performance Testing Tools. Updated: March 2025.
842,592 professionals have used our research since 2012.