Try our new research platform with insights from 80,000+ expert users

Amazon MSK vs Apache Spark Streaming comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Amazon MSK
Ranking in Streaming Analytics
6th
Average Rating
7.4
Number of Reviews
10
Ranking in other categories
No ranking in other categories
Apache Spark Streaming
Ranking in Streaming Analytics
9th
Average Rating
8.0
Reviews Sentiment
6.2
Number of Reviews
10
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of November 2024, in the Streaming Analytics category, the mindshare of Amazon MSK is 9.2%, down from 9.9% compared to the previous year. The mindshare of Apache Spark Streaming is 3.7%, down from 4.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics
 

Featured Reviews

FNU AKSHANSH - PeerSpot reviewer
Streamlines our processes, and we don't need to configure any VPCs; it's automatic
We don't have many use cases involving ingesting large amounts of data and scaling up and down. We have a clear understanding of our data volume, which remains relatively constant throughout the week. While we're aware of other features Amazon MSK offers, we feel confident in our current setup. If our requirements change significantly in the future, we'll reassess our needs and consider adopting Amazon MSK.
Oscar Estorach - PeerSpot reviewer
Versatile and flexible when dealing with large-scale data streams
What I like about Spark is its versatility in supporting multiple languages and that makes it my preferred choice for building scalable and efficient systems, whether it is hooking databases with web applications or handling large-scale data transformations. Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows. It works well in the cloud, and you can structure data using Databricks or Spark, providing flexibility for different projects. Spark Streaming's flexibility shines when dealing with large-scale data streams. It caters to different needs, offering real-time insights for tasks like online sales analytics. The ability to prioritize data streams is valuable, especially for monitoring competitor prices online.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Overall, it is very cost-effective based on the workflow."
"The solution's technical support was helpful."
"Amazon MSK's separation of concerns and ease of creating and deploying new features are highly valuable. It just requires to assign them to the topic, and then anyone who needs to consume these messages can do so directly from Amazon MSK. This separation of concerns makes it very convenient, especially for new feature development, as developers can easily access the messages they need without having to deal with complex server communications or protocol setups."
"MSK has a private network that's an out-of-box feature."
"Amazon MSK has significantly improved our organization by building seamless integration between systems."
"Amazon MSK's scalability is very good."
"It is a stable product."
"It offers good stability."
"Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services."
"Apache Spark Streaming has features like checkpointing and Streaming API that are useful."
"The solution is better than average and some of the valuable features include efficiency and stability."
"Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple."
"It's the fastest solution on the market with low latency data on data transformations."
"As an open-source solution, using it is basically free."
"The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams."
"The solution is very stable and reliable."
 

Cons

"Amazon MSK could improve on the features they offer. They are still lagging behind Confluence."
"It should be more flexible, integration-wise."
"The configuration seems a little complex and the documentation on the product is not available."
"The product's schema support needs enhancement. It will help enhance integration with many kinds of languages of programming languages, especially for environments using languages like .NET."
"Horizontal scale-out is actually not easy, making it an area where improvements are required."
"It would be really helpful if Amazon MSK could provide a single installation that covers all the servers."
"One of the reasons why we prefer Kafka is because the support is a little bit difficult to manage with Amazon MSK."
"In my opinion, there are areas in Amazon MSK that could be improved, particularly in terms of configuration. Initially setting it up and getting it connected was quite challenging. The naming conventions for policies were updated by AWS, and some were undocumented, leading to confusion with outdated materials. It took us weeks of trial and error before discovering new methods through hidden tutorials and official documentation."
"The initial setup is quite complex."
"It was resource-intensive, even for small-scale applications."
"The cost and load-related optimizations are areas where the tool lacks and needs improvement."
"The solution itself could be easier to use."
"The debugging aspect could use some improvement."
"There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused."
"In terms of improvement, the UI could be better."
"The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better."
 

Pricing and Cost Advice

"The platform has better pricing than one of its competitors."
"The price of Amazon MSK is less than some competitor solutions, such as Confluence."
"When you create a complete enterprise-driven architecture that is deployable on an enterprise scale, I would say that the prices of Amazon MSK and Confluent Platform become comparable."
"On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
"I was using the open-source community version, which was self-hosted."
"Spark is an affordable solution, especially considering its open-source nature."
"People pay for Apache Spark Streaming as a service."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
816,406 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
21%
Computer Software Company
19%
Manufacturing Company
7%
Retailer
5%
Financial Services Firm
22%
Computer Software Company
20%
University
6%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Amazon MSK?
Amazon MSK has significantly improved our organization by building seamless integration between systems.
What needs improvement with Amazon MSK?
From AWS, I would consider more MSK schema validation is needed. It is easy to integrate if you have an application, but on-topic integration is more complex. You can do it with EvenBridge very eas...
What is your primary use case for Amazon MSK?
I have used Confluent Cloud and Amazon MSK in my company. We are not using it for analytics and it is more for CDC processes, so we change the capture processes. It is used to extract data from a d...
What do you like most about Apache Spark Streaming?
Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
What needs improvement with Apache Spark Streaming?
The product's event handling capabilities, particularly compared to Kaspersky, need improvement. Integrating event-level streaming capabilities could be beneficial. This aligns with the idea of exp...
What is your primary use case for Apache Spark Streaming?
I've used it more for ETL. It's useful for creating data pipelines, streaming datasets, generating synthetic data, synchronizing data, creating data lakes, and loading and unloading data is fast an...
 

Also Known As

Amazon Managed Streaming for Apache Kafka
Spark Streaming
 

Overview

 

Sample Customers

Expedia, Intuit, Royal Dutch Shell, Brooks Brothers
UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
Find out what your peers are saying about Amazon MSK vs. Apache Spark Streaming and other solutions. Updated: October 2024.
816,406 professionals have used our research since 2012.