Amazon Kinesis vs Apache Spark Streaming comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
12,325 views|9,068 comparisons
88% willing to recommend
Apache Logo
4,104 views|3,301 comparisons
90% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Amazon Kinesis and Apache Spark Streaming based on real PeerSpot user reviews.

Find out in this report how the two Streaming Analytics solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Amazon Kinesis vs. Apache Spark Streaming Report (Updated: May 2024).
772,649 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable feature of Amazon Kinesis is real-time data streaming.""I have worked in companies that build tools in-house. They face scaling challenges.""I find almost all features valuable, especially the timing and fast pace movement.""Everything is hosted and simple.""Amazon Kinesis also provides us with plenty of flexibility.""Amazon Kinesis's main purpose is to provide near real-time data streaming at a consistent 2Mbps rate, which is really impressive.""What turns out to be most valuable is its integration with Lambda functions because you can process the data as it comes in. As soon as data comes, you'll fire a Lambda function to process a trench of data.""Setting Amazon Kinesis up is quick and easy; it only takes a few minutes to configure the necessary settings and start using it."

More Amazon Kinesis Pros →

"As an open-source solution, using it is basically free.""Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.""It's the fastest solution on the market with low latency data on data transformations.""The solution is very stable and reliable.""The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams.""Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple.""Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services.""The solution is better than average and some of the valuable features include efficiency and stability."

More Apache Spark Streaming Pros →

Cons
"One area for improvement in the solution is the file size limitation of 10 Mb. My company works with files with a larger file size. The batch size and throughput also need improvement in Amazon Kinesis.""Kinesis can be expensive, especially when dealing with large volumes of data.""There are certain shortcomings in the machine learning capacity offered by the product, making it an area where improvements are required.""One thing that would be nice would be a policy for increasing the number of Kinesis streams because that's the one thing that's constant. You can change it in real time, but somebody has to change it, or you have to set some kind of meter. So, auto-scaling of adding and removing streams would be nice.""The solution has a two-minute maximum time delay for live streaming, which could be reduced.""Something else to mention is that we use Kinesis with Lambda a lot and the fact that you can only connect one Stream to one Lambda, I find is a limiting factor. I would definitely recommend to remove that constraint.""The price is not much cheaper. So, there is room for improvement in the pricing.""For me, especially with video streams, there's sometimes a kind of delay when the data has to be pumped to other services. This delay could be improved in Kinesis, or especially the Kinesis Video Streams, which is being used for different use cases for Amazon Connect. With that improvement, a lot of other use cases of Amazon Connect integrating with third-party analytic tools would be easier."

More Amazon Kinesis Cons →

"The cost and load-related optimizations are areas where the tool lacks and needs improvement.""We would like to have the ability to do arbitrary stateful functions in Python.""There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused.""Integrating event-level streaming capabilities could be beneficial.""It was resource-intensive, even for small-scale applications.""The solution itself could be easier to use.""In terms of improvement, the UI could be better.""The initial setup is quite complex."

More Apache Spark Streaming Cons →

Pricing and Cost Advice
  • "Under $1,000 per month."
  • "The solution's pricing is fair."
  • "It was actually a fairly high volume we were spending. We were spending about 150 a month."
  • "The fee is based on the number of hours the service is running."
  • "Amazon Kinesis pricing is sometimes reasonable and sometimes could be better, depending on the planning, so it's a five out of ten for me."
  • "In general, cloud services are very convenient to use, even if we have to pay a bit more, as we know what we are paying for and can focus on other tasks."
  • "The tool's entry price is cheap. However, pricing increases with data volume."
  • "The product falls on a bit of an expensive side."
  • More Amazon Kinesis Pricing and Cost Advice →

  • "People pay for Apache Spark Streaming as a service."
  • "I was using the open-source community version, which was self-hosted."
  • "On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
  • "Spark is an affordable solution, especially considering its open-source nature."
  • More Apache Spark Streaming Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
    772,649 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Amazon Kinesis's main purpose is to provide near real-time data streaming at a consistent 2Mbps rate, which is really impressive.
    Top Answer:The solution currently provides an option to retrieve data in the stream or the queue, but it's not that helpful. We have to write some custom scripts to fetch data from there. An option to search for… more »
    Top Answer:Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
    Top Answer:In terms of improvement, the UI could be better. Additionally, Spark Streaming works well for various use cases, but improvements could be made for ultra-fast scenarios where seconds matter. While… more »
    Top Answer:As a data engineer, I use Apache Spark Streaming to process real-time data for web page analytics and integrate diverse data sources into centralized data warehouses.
    Ranking
    1st
    out of 38 in Streaming Analytics
    Views
    12,325
    Comparisons
    9,068
    Reviews
    13
    Average Words per Review
    544
    Rating
    7.7
    8th
    out of 38 in Streaming Analytics
    Views
    4,104
    Comparisons
    3,301
    Reviews
    5
    Average Words per Review
    502
    Rating
    8.2
    Comparisons
    Also Known As
    Amazon AWS Kinesis, AWS Kinesis, Kinesis
    Spark Streaming
    Learn More
    Overview

    Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.

    Spark Streaming makes it easy to build scalable fault-tolerant streaming applications.

    Sample Customers
    Zillow, Netflix, Sonos
    UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
    Top Industries
    REVIEWERS
    Computer Software Company29%
    Media Company29%
    Transportation Company14%
    Non Tech Company14%
    VISITORS READING REVIEWS
    Computer Software Company17%
    Financial Services Firm17%
    Manufacturing Company8%
    Retailer4%
    VISITORS READING REVIEWS
    Financial Services Firm21%
    Computer Software Company19%
    Comms Service Provider6%
    Retailer5%
    Company Size
    REVIEWERS
    Small Business36%
    Midsize Enterprise36%
    Large Enterprise27%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise12%
    Large Enterprise67%
    REVIEWERS
    Small Business60%
    Midsize Enterprise10%
    Large Enterprise30%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise12%
    Large Enterprise67%
    Buyer's Guide
    Amazon Kinesis vs. Apache Spark Streaming
    May 2024
    Find out what your peers are saying about Amazon Kinesis vs. Apache Spark Streaming and other solutions. Updated: May 2024.
    772,649 professionals have used our research since 2012.

    Amazon Kinesis is ranked 1st in Streaming Analytics with 24 reviews while Apache Spark Streaming is ranked 8th in Streaming Analytics with 9 reviews. Amazon Kinesis is rated 8.0, while Apache Spark Streaming is rated 8.0. The top reviewer of Amazon Kinesis writes "Used for media streaming and live-streaming data". On the other hand, the top reviewer of Apache Spark Streaming writes "Easy integration, beneficial auto-scaling, and good open-sourced support community". Amazon Kinesis is most compared with Azure Stream Analytics, Amazon MSK, Confluent, Apache Flink and Databricks, whereas Apache Spark Streaming is most compared with Spring Cloud Data Flow, Azure Stream Analytics, Apache Pulsar, Confluent and Starburst Enterprise. See our Amazon Kinesis vs. Apache Spark Streaming report.

    See our list of best Streaming Analytics vendors.

    We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.