Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Appium comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.1
Number of Reviews
92
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
Appium
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
30
Ranking in other categories
Mobile Development Platforms (7th), Regression Testing Tools (6th)
 

Mindshare comparison

Apache JMeter and Appium aren’t in the same category and serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 24.7%, up 22.2% compared to last year.
Appium, on the other hand, focuses on Mobile Development Platforms, holds 5.4% mindshare, down 8.0% since last year.
Performance Testing Tools
Mobile Development Platforms
 

Featured Reviews

AlexLogan - PeerSpot reviewer
It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve
I rate JMeter five out of 10. You need knowledgeable employees to work with the tool because it's difficult to learn. There is a steep learning curve, so you shouldn't expect an entry-level engineer to pick up the tool quickly and become proficient. It takes a considerable amount of time.
Abhishek-Tiwari - PeerSpot reviewer
Has cross-platform flexibility and a record-and-play option
The challenging part with Appium is that installation can be a bit tricky. It can be challenging to set up in Android versus iOS environments. Appium has some limitations in terms of writing code using simulators and online cloud devices. I faced challenges with native based scenarios, battery turn out percentage, battery charging percentage, and memory capacity. The other challenge I faced involved codes changing from device to device. For example, the piece of code that works in iOS version 10.1 won't work in iOS version 6.0. In upcoming releases, if they can reduce some more of the dependencies like SDK, UIAutomator, etc., it would be great. That is, I'd like to see a consolidated package or bundle release that is much more user-friendly.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The ease of use is the solution's most valuable feature. Also, the ability to easily create test cases is also very good. It's easy to just ramp up on the solution."
"The biggest thing I liked about it is that there is a huge user base out there, and being shareware and being Apache, if I have any question on how to get something done, I get 18 different answers. Out of those, there would be at least a few good approaches for what I was trying to do. So, the support system out there is most valuable."
"One valuable feature of Apache JMeter is the ability to replicate scenarios where bulk files have to be uploaded via API."
"When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution."
"The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences."
"We find the load testing feature valuable."
"JMeter lets us generate virtual users and T-load, per our requirements. It's easy to configure and adjusting the virtual users according to the DPS we want to achieve."
"The thread groups, samplers, and listeners, which are all determined by the script's requirements, are the most valuable features of this solution."
"The automation part is extremely helpful in streamlining our processes."
"The most valuable feature is that it's easy to launch applications. Appium has everything that Selenium has. So many good tools support Appium. We can take some Excel sheets and use them to fill out the text box that's in there. We can also take screenshots of failures."
"Appium helps me to do as much as much as I want to."
"Obviously because of automation, it reduces manual testing efforts."
"Appium's best feature is that it supports multiple frameworks."
"It's an open-source solution with a very large community and available documentation."
"The library is extensive so the driver interacts with most functions or actions on mobile devices."
"The most valuable features of Appium are the in-built functionality, which we can use in our code. For example, move back, move front, navigate one page before, and navigate one page ahead. You can do this by using the in-built functions from Appium."
 

Cons

"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"There are certain things like we can't merge custom metrics into the JMeter reports. We're limited to JMeter metrics, and other server metrics can't be integrated with JMeter dashboard. This forces us to rely on another tool."
"Until now, JMeter is not supporting most of the protocols."
"They should improve the solution on its UI front."
"Self-healing and page rendering for the end-users are not available in Apache JMeter."
"It's not easy to get the data from one place or to do customizations."
"Running JMeter in GUI mode uses a lot of memory, which means we need to switch to a non-GUI mode when using a heavy load."
"Apache JMeter could use improvement in reporting. Currently, it isn't easy to generate reports in PDF format. While receiving reports in PDF format is possible, it requires a lot of customization. Additionally, when comparing the load test to others solutions it could improve."
"There is always a concern about the amount of code that is required to enhance the automation process. The idea of having less code or no code is what we would like to see in future updates."
"The setup and installation were a problem for us at first."
"I rarely use Appium nowadays because I'm now at the managerial level, but the last time I used it, whenever I selected and clicked on an element, Appium was very slow. I tried to debug it, but I still couldn't find the problem, so this is an area for improvement in the solution. Another area for improvement lies with the connector and server. For example, the effort to get into the local machine sometimes causes the emulator to become slow, which then leads to failure in testing, and this is the usual issue I've encountered from Appium. An additional feature I'd like added to Appium in its next release is being able to do automation in iOS without using XPath and the name of the element. In Xcode, you can use previous UI tests for detecting elements, but in Appium, you have to use Xpath and the element name instead of being able to directly put the X-UiPath, which is what you can do in Xcode. In iOS as well, sometimes the element doesn't have a name or a path. Sometimes, there's also no element."
"One area where I think Appium could improve is in addressing security concerns for our data. Currently, we're unable to use cloud solutions like CloudForm due to security restrictions on our servers. We also face challenges in updating packages for the same reason. It would be beneficial if the solution could provide better support for auto-reporting and easier connections to mobile device farms."
"They should add an in-built framework."
"What needs improvement in Appium is its documentation. It needs to give more context on the libraries that Appium is using under the hood. For example, my team is using Appium for Android automation, and a lot of times, I feel that there's functionality that's available through the Appium interface, that exists within the UIAutomator, but there aren't a lot of useful or helpful resources on the internet to find that information, so it would be good to have some linkage with the underlying platform itself. Another room for improvement in Appium is that it's buggy sometimes. For example, at times, there's a bug in the inspector application that doesn't allow me to save my desired capability set, so it would be nice to get that bug fixed, but overall, Appium is a good tool. The Touch Actions functionality in Appium also needs improvement. For example, if I want to initiate a scroll on the device that I'm running Appium on, sometimes Swipe works, but in other situations, I have to explicitly use action chains, so I'm not too sure what's the better approach. What I'd like to see in the next version of Appium is a more intelligent and more intuitive AppiumLibrary, in terms of identifying menus and scroll bars, etc., because right now, I'm unsure if I have to do a lot of export reversals to get to the elements I'm looking for. It would be nice to have some functionality built in, which would allow me to easily get those exports."
"Configuration-wise, there is a lot of room for improvement."
"It needs to accommodate applications that use React.js and AngularJS."
 

Pricing and Cost Advice

"JMeter is open source, so there are no licensing costs associated with it."
"Apache JMeter is a free, open-source solution."
"We are using the free version, and if required, we can easily switch to the other version."
"This is an open-source solution, so there are no licensing costs associated with it."
"No licensing is required as it is a free, open-source tool."
"Free"
"Since it's free, there's no need for extensive support or improvements in pricing."
"It is open source. There are no licensing costs associated. If you need enterprise support, you'll probably end up paying for a license. You would also factor in the infrastructure cost, but that's not significant."
"We found out that we could explore features of the solution for 30 days trial. We can switch to a permanent license later if we want."
"As far as I know, Appium is a free solution. It's not for commercial use."
"The solution is free."
"Appium is open source; we can use it for free."
"It's open source, so it's completely free."
"Appium is free and open-source."
"The price is good for people to be able to make a favorable decision for the value."
"The solution is open-source."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
824,067 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
16%
Manufacturing Company
8%
Government
7%
Financial Services Firm
20%
Computer Software Company
14%
Manufacturing Company
8%
Insurance Company
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
Do you recommend Appium?
I do recommend Appium. It is an open-source solution and completely free of charge. We use Appium and Appium Studio as our base for any type of mobile automation for testing. It has a great interfa...
What do you like most about Appium?
Appium helps me to do as much as much as I want to.
What is your experience regarding pricing and costs for Appium?
My experience with Appium from a pricing perspective is favorable due to it being open source, making it a cost-effective option.
 

Comparisons

 

Also Known As

JMeter
No data available
 

Learn More

 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Nuvizz, Coupa Software, Eventbrite, Evernote
Find out what your peers are saying about Apache, Tricentis, OpenText and others in Performance Testing Tools. Updated: December 2024.
824,067 professionals have used our research since 2012.