No more typing reviews! Try our Samantha, our new voice AI agent.

Apache Spark vs IBM Spectrum Computing comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Spark
Ranking in Hadoop
1st
Average Rating
8.4
Reviews Sentiment
6.9
Number of Reviews
69
Ranking in other categories
Compute Service (6th), Java Frameworks (2nd)
IBM Spectrum Computing
Ranking in Hadoop
7th
Average Rating
7.8
Reviews Sentiment
5.9
Number of Reviews
9
Ranking in other categories
Cloud Management (43rd)
 

Mindshare comparison

As of November 2026, in the Hadoop category, the mindshare of Apache Spark is 14.4%, down from 17.1% compared to the previous year. The mindshare of IBM Spectrum Computing is 4.9%, up from 3.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Hadoop Mindshare Distribution
ProductMindshare (%)
Apache Spark14.4%
IBM Spectrum Computing4.9%
Other80.7%
Hadoop
 

Featured Reviews

Devindra Weerasooriya - PeerSpot reviewer
Data Architect at Devtech
Provides a consistent framework for building data integration and access solutions with reliable performance
The in-memory computation feature is certainly helpful for my processing tasks. It is helpful because while using structures that could be held in memory rather than stored during the period of computation, I go for the in-memory option, though there are limitations related to holding it in memory that need to be addressed, but I have a preference for in-memory computation. The solution is beneficial in that it provides a base-level long-held understanding of the framework that is not variant day by day, which is very helpful in my prototyping activity as an architect trying to assess Apache Spark, Great Expectations, and Vault-based solutions versus those proposed by clients like TIBCO or Informatica.
OmarIsmail1 - PeerSpot reviewer
Infrastructure Technical Specialist II at Clicks Group
Senior Technical Specialist appreciates intelligent workload management, strong support, and scalability
The best features of IBM Spectrum Computing are common across many of their storage products. The software is solid, meaning that the code is stable. They take business seriously, which is what IBM stands for - International Business Machines. They always maintain a business-oriented approach in their software development. It's not simply clicking through interfaces; in IBM software, they consider their actions, process flows, and workflows around business processes. It requires understanding IBM and their methodology, as the software operates accordingly. I have utilized IBM Spectrum Computing's intelligent workload management feature. We use Insights, which is connected to the cloud. This provides AI capabilities for analyzing the configuration, offering smart recommendations on new code, warning about bugs in current code, and suggesting configuration improvements through its advisor tool. The predictive analytics feature in IBM Spectrum Computing enables optimal software performance through Insights. However, being a storage administrator requires foundational knowledge and understanding beyond these tools. For troubleshooting, it's efficient in spotting bottlenecks, but understanding the terms and metrics is essential as it provides answers that need interpretation.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The good performance. The nice graphical management console. The long list of ML algorithms."
"The features we find most valuable are the machine learning, data learning, and Spark Analytics."
"Spark can handle small to huge data and is suitable for any size of company."
"One of Apache Spark's most valuable features is that it supports in-memory processing, the execution of jobs compared to traditional tools is very fast."
"I like that Apache Spark can handle multiple tasks parallelly, and I also like the automation feature, while JavaScript helps with the parallel streaming of the library."
"The most valuable feature of Apache Spark is its memory processing because it processes data over RAM rather than disk, which is much more efficient and fast."
"Spark is used for transformations from large volumes of data, and it is usefully distributed."
"After using Spark, we were able to accomplish this task within hours."
"The most valuable aspect of the product is the policy driving resource management, to optimize the computing across data centers."
"The most valuable feature is the backup capability."
"I have utilized IBM Spectrum Computing's intelligent workload management feature through Insights, which is connected to the cloud."
"This solution is working for both VTL and tape."
"Spectrum Computing is one of the best tools in the data management and services area, as it can process huge amounts of data with standardized data management and provides a great data governance capability."
"We are satisfied with the technical support, we have no issues."
"IBM's ability to cluster compute resources is impressive, with built-in support for scenarios like VR and active-active configurations,"
"The best features of IBM Spectrum Computing are common across many of their storage products."
 

Cons

"The solution needs to optimize shuffling between workers."
"I do not know exactly what was the reason to move away from Apache Spark or the underlying database system, but it was simply a decision driven by the customer."
"If you have a Spark session in the background, sometimes it's very hard to kill these sessions because of D allocation."
"They currently use a JDK version which is a little bit old. Not all features are on it."
"It should support more programming languages."
"Stream processing needs to be developed more in Spark. I have used Flink previously. Flink is better than Spark at stream processing."
"The Spark solution could improve in scheduling tasks and managing dependencies."
"Although you are able to perform complex transformations using Spark libraries, the support for SQL to perform transformations is still limited."
"The deduplication software isn't quite up to speed with the market. While IBM has excellent compression technology, specifically on their FlashCore modules, they lag behind competitors such as NetApp in deduplication capabilities."
"In Pakistan, IBM's disadvantage is the lack of OEM support and presence."
"IBM's sales and support structure can be challenging."
"We'd like to see some AI model training for machine learning."
"The deduplication software isn't quite up to speed with the market."
"This solution is no longer managing tapes correctly."
"SMB storage and HPC is not compatible and it should be supported by IBM Spectrum Computing."
"Spectrum Computing is lagging behind other products, most likely because it hasn't been shifted to the cloud."
 

Pricing and Cost Advice

"It is an open-source solution, it is free of charge."
"We are using the free version of the solution."
"On the cloud model can be expensive as it requires substantial resources for implementation, covering on-premises hardware, memory, and licensing."
"Apache Spark is an open-source solution, and there is no cost involved in deploying the solution on-premises."
"The tool is an open-source product. If you're using the open-source Apache Spark, no fees are involved at any time. Charges only come into play when using it with other services like Databricks."
"The product is expensive, considering the setup."
"It is quite expensive. In fact, it accounts for almost 50% of the cost of our entire project."
"Since we are using the Apache Spark version, not the data bricks version, it is an Apache license version, the support and resolution of the bug are actually late or delayed. The Apache license is free."
"This solution is expensive."
"Spectrum Computing is one of the most expensive products on the market."
report
Use our free recommendation engine to learn which Hadoop solutions are best for your needs.
922,528 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
16%
Outsourcing Company
10%
Comms Service Provider
9%
Construction Company
9%
Comms Service Provider
14%
Construction Company
11%
Outsourcing Company
11%
Manufacturing Company
11%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business28
Midsize Enterprise16
Large Enterprise33
By reviewers
Company SizeCount
Small Business3
Midsize Enterprise1
Large Enterprise6
 

Questions from the Community

What is your experience regarding pricing and costs for Apache Spark?
Apache Spark is open-source, so it doesn't incur any charges.
What needs improvement with Apache Spark?
I find that there really lacks the technical depth to do any recommendations for future updates of Apache Spark. I used it for two years for our prototype work and testing things, but because I had...
What is your primary use case for Apache Spark?
I attempted to use Apache Spark in one of our customer projects, but after the initial test, our customer moved to another technology and another database system. I do not have any final remarks on...
What is your experience regarding pricing and costs for IBM Spectrum Computing?
IBM Spectrum Computing consistently offers competitive pricing. When solutioning new implementations, IBM always presents the best solution and price. In a recent comparison with Pure Storage and N...
What needs improvement with IBM Spectrum Computing?
IBM Spectrum Computing had limitations with remote copy services between head office and disaster recovery sites. In the last year, IBM has improved the code by re-engineering it to policy-based re...
What is your primary use case for IBM Spectrum Computing?
The typical use case for IBM Spectrum Computing is that it's an all-rounder. It can be used in various scenarios, such as the retailer I work for that has batch processing. It's on-demand w...
 

Also Known As

No data available
IBM Platform Computing
 

Overview

 

Sample Customers

NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
London South Bank University, Transvalor, Infiniti Red Bull Racing, Genomic
Find out what your peers are saying about Apache Spark vs. IBM Spectrum Computing and other solutions. Updated: November 2026.
922,528 professionals have used our research since 2012.