Try our new research platform with insights from 80,000+ expert users

Apache Spark vs npm comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Spark
Ranking in Java Frameworks
2nd
Average Rating
8.4
Reviews Sentiment
7.7
Number of Reviews
65
Ranking in other categories
Hadoop (1st), Compute Service (4th)
npm
Ranking in Java Frameworks
7th
Average Rating
8.8
Number of Reviews
5
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of April 2025, in the Java Frameworks category, the mindshare of Apache Spark is 5.5%, down from 7.5% compared to the previous year. The mindshare of npm is 0.1%, down from 0.1% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Java Frameworks
 

Featured Reviews

Ilya Afanasyev - PeerSpot reviewer
Reliable, able to expand, and handle large amounts of data well
We use batch processing. It works well with our formats and file versions. There's a lot of functionality. In our pipeline each hour, we make a copy of data from MongoDB, of the changes from MongoDB to some specific file. Each time pipeline copied all of the data, it would do it each time without changes to all of the tables. Tables have a lot of data, and in the last MongoDB version, there is a possibility to read only changed data. This reduced the cost and configuration of the cluster, and we saved about $150,000. The solution is scalable. It's a stable product.
Puneeth Babu - PeerSpot reviewer
Is scalable, easily approachable, stable, and easy to set up
There are a lot of features that are very fast in npm, even though it was developed 10 or 12 years back. It comes with a bundle or library, so your development time will radically reduce to half. If you need to spin up a new server or you need to have a developer at minimum cost, it can be easily achieved within npm. Overall, I give npm a nine out of ten.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The processing time is very much improved over the data warehouse solution that we were using."
"Now, when we're tackling sentiment analysis using NLP technologies, we deal with unstructured data—customer chats, feedback on promotions or demos, and even media like images, audio, and video files. For processing such data, we rely on PySpark. Beneath the surface, Spark functions as a compute engine with in-memory processing capabilities, enhancing performance through features like broadcasting and caching. It's become a crucial tool, widely adopted by 90% of companies for a decade or more."
"Provides a lot of good documentation compared to other solutions."
"The product’s most valuable features are lazy evaluation and workload distribution."
"It is highly scalable, allowing you to efficiently work with extensive datasets that might be problematic to handle using traditional tools that are memory-constrained."
"We use it for ETL purposes as well as for implementing the full transformation pipelines."
"The tool's most valuable feature is its speed and efficiency. It's much faster than other tools and excels in parallel data processing. Unlike tools like Python or JavaScript, which may struggle with parallel processing, it allows us to handle large volumes of data with more power easily."
"The scalability has been the most valuable aspect of the solution."
"The solution is scalable."
"It's an open-source setting that's very scalable and easily approachable. I like that you can plug in many features to my product."
"The reversal build, gendered build, migrated PCA, and CT features are excellent."
"The product's most valuable feature is dependency installation."
"The most valuable feature of NPM is to trigger APMs."
 

Cons

"Needs to provide an internal schedule to schedule spark jobs with monitoring capability."
"Stability in terms of API (things were difficult, when transitioning from RDD to DataFrames, then to DataSet)."
"When you want to extract data from your HDFS and other sources then it is kind of tricky because you have to connect with those sources."
"If you have a Spark session in the background, sometimes it's very hard to kill these sessions because of D allocation."
"It should support more programming languages."
"Technical expertise from an engineer is required to deploy and run high-tech tools, like Informatica, on Apache Spark, making it an area where improvements are required to make the process easier for users."
"Dynamic DataFrame options are not yet available."
"We've had problems using a Python process to try to access something in a large volume of data. It crashes if somebody gives me the wrong code because it cannot handle a large volume of data."
"NPM can improve the package manager. For the packages we download for our APM studio to trigger our APM driver, it would benefit if we could have the latest version of NuGet Package Manager within the package manager control. For example, Visual Studio would be good. Then it would be easy for us to get the package manager from there instead of Googling it out and matching it with the current version. It would be less time-consuming for us."
"The product should be compatible with various programming languages, including both native and upcoming languages."
"I would like to see compatible versions, and what new features they will be providing. If it is a useful feature I can merge it. If it is not a usable feature, then I can ignore the newer version."
"The library could be updated."
"Some of the libraries that we try to use in npm have issues with security. Also, because it's an open-source solution, I think there are lots of challenges with security. So, the security layer could be improved."
 

Pricing and Cost Advice

"It is quite expensive. In fact, it accounts for almost 50% of the cost of our entire project."
"We are using the free version of the solution."
"The solution is affordable and there are no additional licensing costs."
"They provide an open-source license for the on-premise version."
"The tool is an open-source product. If you're using the open-source Apache Spark, no fees are involved at any time. Charges only come into play when using it with other services like Databricks."
"I did not pay anything when using the tool on cloud services, but I had to pay on the compute side. The tool is not expensive compared with the benefits it offers. I rate the price as an eight out of ten."
"On the cloud model can be expensive as it requires substantial resources for implementation, covering on-premises hardware, memory, and licensing."
"Spark is an open-source solution, so there are no licensing costs."
"It's an open-source solution, and there are no hidden fees."
"We use the open-source version, so it is free."
"The licensing cost is around one hundred and fifty dollars on a quarterly basis."
"NPM is an open-source solution."
report
Use our free recommendation engine to learn which Java Frameworks solutions are best for your needs.
845,406 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
28%
Computer Software Company
13%
Manufacturing Company
8%
Comms Service Provider
5%
No data available
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What do you like most about Apache Spark?
We use Spark to process data from different data sources.
What is your experience regarding pricing and costs for Apache Spark?
Compared to other solutions like Doc DB, Spark is more costly due to the need for extensive infrastructure. It requires significant investment in infrastructure, which can be expensive. While cloud...
What needs improvement with Apache Spark?
The Spark solution could improve in scheduling tasks and managing dependencies. Spark alone cannot handle sequential tasks, requiring environments like Airflow scheduler or scripts. For instance, o...
What do you like most about NPM?
The product's most valuable feature is dependency installation.
What needs improvement with NPM?
The product should be compatible with various programming languages, including both native and upcoming languages. There should be an extension for C++ language as many customers prefer it for the ...
What is your primary use case for NPM?
We use the product as a packet manager for orchestration and dashboard management. It helps in running the development server.
 

Comparisons

No data available
 

Overview

 

Sample Customers

NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
slack, microsoft, netflix, adobe, docker, visa, splunk, zillow
Find out what your peers are saying about Apache Spark vs. npm and other solutions. Updated: March 2025.
845,406 professionals have used our research since 2012.