Try our new research platform with insights from 80,000+ expert users

Amazon Kinesis vs Google Cloud Dataflow comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Amazon Kinesis
Ranking in Streaming Analytics
2nd
Average Rating
8.0
Number of Reviews
26
Ranking in other categories
No ranking in other categories
Google Cloud Dataflow
Ranking in Streaming Analytics
8th
Average Rating
7.8
Number of Reviews
10
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of November 2024, in the Streaming Analytics category, the mindshare of Amazon Kinesis is 10.6%, down from 15.4% compared to the previous year. The mindshare of Google Cloud Dataflow is 8.3%, up from 6.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics
 

Featured Reviews

Rajni Kumar Jha - PeerSpot reviewer
Apr 3, 2024
Used for media streaming and live-streaming data
It is not compulsory to use Amazon Kinesis. If you don't want to use the data streaming, you can use just the Kinesis data firehose. Using the Kinesis data firehose is compulsory because we can't store all chats and recordings in Amazon S3 without it. When a call comes in the Amazon Kinesis instance, it will go to Data Streams if we use it. Otherwise, it will go to the Kinesis data firehose, where we need to define the S3 bucket path, and it will go to Amazon S3. So, without the Kinesis data firehose, we can't store all the chats and recordings in Amazon S3. Using Amazon Kinesis totally depends upon the user's requirements. If you want to use live streaming for the data lake or data analyst team, you need to use Amazon Kinesis. If you don't want to use it, you can directly use the Kinesis data firehose, which will be stored in Amazon S3. Overall, I rate the solution an eight out of ten.
Tamer Talal - PeerSpot reviewer
Feb 14, 2024
A tool useful for data transmission and data storage that needs to improve its authentication area
I use the solution in my company for data transmission and data storage One of the good features of the product is the overall capacity that it provides to its users. Though the speed of the product is good, the main feature of the product that I like is its capacity. The authentication part of…

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The scalability is pretty good."
"The product's initial setup phase is not difficult because we are using the tool on the cloud."
"The feature that I've found most valuable is the replay. That is one of the most valuable in our business. We are business-to-business so replay was an important feature - being able to replay for 24 hours. That's an important feature."
"The most valuable feature of Amazon Kinesis is real-time data streaming."
"The solution has the capacity to store the data anywhere from one day to a week and provides limitless storage for us."
"There is no problem with the tool's stability."
"One of the best features of Amazon Kinesis is the multi-partition."
"Its scalability is very high. There is no maintenance and there is no throughput latency. I think data scalability is high, too. You can ingest gigabytes of data within seconds or milliseconds."
"The support team is good and it's easy to use."
"The best feature of Google Cloud Dataflow is its practical connectedness."
"The service is relatively cheap compared to other batch-processing engines."
"I don't need a server running all the time while using the tool. It is also easy to setup. The product offers a pay-as-you-go service."
"The product's installation process is easy...The tool's maintenance part is somewhat easy."
"The solution allows us to program in any language we desire."
"It is a scalable solution."
"Google Cloud Dataflow is useful for streaming and data pipelines."
 

Cons

"Something else to mention is that we use Kinesis with Lambda a lot and the fact that you can only connect one Stream to one Lambda, I find is a limiting factor. I would definitely recommend to remove that constraint."
"Amazon Kinesis should improve its limits."
"In order to do a successful setup, the person handling the implementation needs to know the solution very well. You can't just come into it blind and with little to no experience."
"Lacks first in, first out queuing."
"The solution has a two-minute maximum time delay for live streaming, which could be reduced."
"Could include features that make it easier to scale."
"We were charged high costs for the solution’s enhanced fan-out feature."
"Amazon Kinesis involved a more complex setup and configuration than Azure Event Hub."
"The deployment time could also be reduced."
"They should do a market survey and then make improvements."
"There are certain challenges regarding the Google Cloud Composer which can be improved."
"Google Cloud Data Flow can improve by having full simple integration with Kafka topics. It's not that complicated, but it could improve a bit. The UI is easy to use but the experience could be better. There are other tools available that do a better job."
"I would like Google Cloud Dataflow to be integrated with IT data flow and other related services to make it easier to use as it is a complex tool."
"The technical support has slight room for improvement."
"When I deploy the product in local errors, a lot of errors pop up which are not always caught. The solution's error logging is bad. It can take a lot of time to debug the errors. It needs to have better logs."
"Google Cloud Dataflow should include a little cost optimization."
 

Pricing and Cost Advice

"Under $1,000 per month."
"The fee is based on the number of hours the service is running."
"The tool's pricing is cheap."
"I think for us, with Amazon Kinesis, if we have to set up our own Kafka or cluster, it will be very time-consuming. If one considers the aforementioned aspect, Amazon Kinesis is a cheap tool."
"The solution's pricing is fair."
"It was actually a fairly high volume we were spending. We were spending about 150 a month."
"In general, cloud services are very convenient to use, even if we have to pay a bit more, as we know what we are paying for and can focus on other tasks."
"Amazon Kinesis is an expensive solution."
"The tool is cheap."
"The solution is cost-effective."
"On a scale from one to ten, where one is cheap, and ten is expensive, I rate Google Cloud Dataflow's pricing a four out of ten."
"Google Cloud Dataflow is a cheap solution."
"Google Cloud is slightly cheaper than AWS."
"On a scale from one to ten, where one is cheap, and ten is expensive, I rate the solution's pricing a seven to eight out of ten."
"The price of the solution depends on many factors, such as how they pay for tools in the company and its size."
"The solution is not very expensive."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
814,649 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
18%
Financial Services Firm
18%
Manufacturing Company
10%
Retailer
4%
Financial Services Firm
17%
Computer Software Company
12%
Retailer
12%
Manufacturing Company
11%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Amazon Kinesis?
Amazon Kinesis's main purpose is to provide near real-time data streaming at a consistent 2Mbps rate, which is really impressive.
What is your experience regarding pricing and costs for Amazon Kinesis?
I think for us, with Amazon Kinesis, if we have to set up our own Kafka or cluster, it will be very time-consuming. If one considers the aforementioned aspect, Amazon Kinesis is a cheap tool.
What needs improvement with Amazon Kinesis?
There are some kind of hard limits on Amazon Kinesis, and if you hit that, then you will get the throughput exceed error. We have to deal with and reduce how many consumers are hitting Amazon Kines...
What do you like most about Google Cloud Dataflow?
The product's installation process is easy...The tool's maintenance part is somewhat easy.
What needs improvement with Google Cloud Dataflow?
The authentication part of the product is an area of concern where improvements are required. For some common users, the solution's authentication part is difficult to use. The scalability of the p...
 

Also Known As

Amazon AWS Kinesis, AWS Kinesis, Kinesis
Google Dataflow
 

Overview

 

Sample Customers

Zillow, Netflix, Sonos
Absolutdata, Backflip Studios, Bluecore, Claritics, Crystalloids, Energyworx, GenieConnect, Leanplum, Nomanini, Redbus, Streak, TabTale
Find out what your peers are saying about Amazon Kinesis vs. Google Cloud Dataflow and other solutions. Updated: October 2024.
814,649 professionals have used our research since 2012.