Amazon MSK vs Google Cloud Dataflow comparison

Amazon Web Services (AWS) and Google are both solutions in the Streaming Analytics category. Amazon Web Services (AWS) is ranked #6 with an average rating of 7.4, while Google is ranked #8 with an average rating of 7.7. Amazon Web Services (AWS) holds a 9.2% mindshare in SA, compared to Google’s 8.3% mindshare. Additionally, 90% of Amazon Web Services (AWS) users are willing to recommend the solution, compared to 90% of Google users who would recommend it.

Amazon MSK

Read 10 Amazon MSK reviews

5,757 Views
4,452 Comparison Views

90% willing to recommend

Google Cloud Dataflow

Read 10 Google Cloud Dataflow reviews

4,001 Views
3,284 Comparison Views

90% willing to recommend

Amazon MSK

Google Cloud Dataflow

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Amazon MSK and Google Cloud Dataflow based on real PeerSpot user reviews.

Find out in this report how the two Streaming Analytics solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.

To learn more, read our detailed Amazon MSK vs. Google Cloud Dataflow Report (Updated: October 2024).

Buyer's Guide

Amazon MSK vs. Google Cloud Dataflow

October 2024

Download the complete report

Helped 816,406 peers since 2012

Categories and Ranking

Amazon MSK

Ranking in Streaming Analytics

6th

Average Rating

7.4

Number of Reviews

Ranking in other categories

No ranking in other categories

Google Cloud Dataflow

Ranking in Streaming Analytics

8th

Average Rating

7.8

Reviews Sentiment

7.0

Number of Reviews

Ranking in other categories

No ranking in other categories

Mindshare comparison

As of November 2024, in the Streaming Analytics category, the mindshare of Amazon MSK is 9.2%, down from 9.9% compared to the previous year. The mindshare of Google Cloud Dataflow is 8.3%, up from 6.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Streaming Analytics

Featured Reviews

FNU AKSHANSH

Senior Data Engineer at a computer software company with 201-500 employees

Streamlines our processes, and we don't need to configure any VPCs; it's automatic

We don't have many use cases involving ingesting large amounts of data and scaling up and down. We have a clear understanding of our data volume, which remains relatively constant throughout the week. While we're aware of other features Amazon MSK offers, we feel confident in our current setup. If our requirements change significantly in the future, we'll reassess our needs and consider adopting Amazon MSK.

Read full review

Tamer Talal

Satellite System Engineer at NARSS

A tool useful for data transmission and data storage that needs to improve its authentication area

The authentication part of the product is an area of concern where improvements are required. For some common users, the solution's authentication part is difficult to use. The scalability of the product is an area of concern where improvements are required. In the future, the product should be made available at a cheaper rate.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"It offers good stability."

"Amazon MSK's scalability is very good."

"Amazon MSK has significantly improved our organization by building seamless integration between systems."

"Amazon MSK has good integration because our team has been undergoing significant changes. Coupling it with MSK within AWS is helpful. We don't have to set up additionals or monitor external environments. This"

"MSK has a private network that's an out-of-box feature."

"It is a stable product."

"The most valuable feature of Amazon MSK is the integration."

"The solution's technical support was helpful."

More Amazon MSK pros

"The most valuable features of Google Cloud Dataflow are scalability and connectivity."

"The service is relatively cheap compared to other batch-processing engines."

"I don't need a server running all the time while using the tool. It is also easy to setup. The product offers a pay-as-you-go service."

"The support team is good and it's easy to use."

"The solution allows us to program in any language we desire."

"The product's installation process is easy...The tool's maintenance part is somewhat easy."

"It is a scalable solution."

"The best feature of Google Cloud Dataflow is its practical connectedness."

More Google Cloud Dataflow pros

Cons

"It would be really helpful if Amazon MSK could provide a single installation that covers all the servers."

"The product's schema support needs enhancement. It will help enhance integration with many kinds of languages of programming languages, especially for environments using languages like .NET."

"Horizontal scale-out is actually not easy, making it an area where improvements are required."

"Amazon MSK could improve on the features they offer. They are still lagging behind Confluence."

"It does not autoscale. Because if you do keep it manually when you add a note to the cluster and then you register it, then it is scalable, but the fact that you have to go and do it, I think, makes it, again, a bit of some operational overhead when managing the cluster."

"It should be more flexible, integration-wise."

"One of the reasons why we prefer Kafka is because the support is a little bit difficult to manage with Amazon MSK."

"The configuration seems a little complex and the documentation on the product is not available."

More Amazon MSK cons

"Google Cloud Dataflow should include a little cost optimization."

"There are certain challenges regarding the Google Cloud Composer which can be improved."

"The technical support has slight room for improvement."

"I would like Google Cloud Dataflow to be integrated with IT data flow and other related services to make it easier to use as it is a complex tool."

"The deployment time could also be reduced."

"When I deploy the product in local errors, a lot of errors pop up which are not always caught. The solution's error logging is bad. It can take a lot of time to debug the errors. It needs to have better logs."

"They should do a market survey and then make improvements."

"The authentication part of the product is an area of concern where improvements are required."

More Google Cloud Dataflow cons

Pricing and Cost Advice

"The platform has better pricing than one of its competitors."

"The price of Amazon MSK is less than some competitor solutions, such as Confluence."

"When you create a complete enterprise-driven architecture that is deployable on an enterprise scale, I would say that the prices of Amazon MSK and Confluent Platform become comparable."

"Google Cloud is slightly cheaper than AWS."

"On a scale from one to ten, where one is cheap, and ten is expensive, I rate the solution's pricing a seven to eight out of ten."

"On a scale from one to ten, where one is cheap, and ten is expensive, I rate Google Cloud Dataflow's pricing a four out of ten."

"The solution is cost-effective."

"The solution is not very expensive."

"Google Cloud Dataflow is a cheap solution."

"The price of the solution depends on many factors, such as how they pay for tools in the company and its size."

"The tool is cheap."

See which vendors are best for you

Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.

See recommendations

816,406 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

21%

Computer Software Company

19%

Manufacturing Company

Retailer

Financial Services Firm

17%

Retailer

12%

Computer Software Company

11%

Manufacturing Company

11%

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

What do you like most about Amazon MSK?

Amazon MSK has significantly improved our organization by building seamless integration between systems.

See all answers

What needs improvement with Amazon MSK?

From AWS, I would consider more MSK schema validation is needed. It is easy to integrate if you have an application, but on-topic integration is more complex. You can do it with EvenBridge very eas...

See all answers

What is your primary use case for Amazon MSK?

I have used Confluent Cloud and Amazon MSK in my company. We are not using it for analytics and it is more for CDC processes, so we change the capture processes. It is used to extract data from a d...

See all answers

What do you like most about Google Cloud Dataflow?

The product's installation process is easy...The tool's maintenance part is somewhat easy.

See all answers

What is your experience regarding pricing and costs for Google Cloud Dataflow?

The solution is not very expensive.

See all answers

What needs improvement with Google Cloud Dataflow?

See all answers

Comparisons

Azure Stream Analytics vs Amazon MSK

Compared 29% of the time

Confluent vs Amazon MSK

Compared 24% of the time

Amazon Kinesis vs Amazon MSK

Compared 16% of the time

Apache Flink vs Amazon MSK

Compared 5% of the time

Aiven Platform vs Amazon MSK

Compared 3% of the time

More Amazon MSK Competitors

Databricks vs Google Cloud Dataflow

Compared 41% of the time

Apache NiFi vs Google Cloud Dataflow

Compared 11% of the time

Apache Flink vs Google Cloud Dataflow

Compared 9% of the time

Spring Cloud Data Flow vs Google Cloud Dataflow

Compared 8% of the time

Amazon Kinesis vs Google Cloud Dataflow

Compared 5% of the time

More Google Cloud Dataflow Competitors

Product Reports

Buyer's Guide

Amazon MSK

November 2024

Download Amazon MSK product report

Buyer's Guide

Streaming Analytics

November 2024

Download Google Cloud Dataflow product report

Also Known As

Amazon Managed Streaming for Apache Kafka

Google Dataflow

Learn More

Amazon Web Services (AWS)

Google

Overview

Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that enables you to build and run applications that use Apache Kafka to process streaming data. Amazon MSK provides the control-plane operations, such as those for creating, updating, and deleting clusters.

Google Dataflow is a unified programming model and a managed service for developing and executing a wide range of data processing patterns including ETL, batch computation, and continuous computation. Cloud Dataflow frees you from operational tasks like resource management and performance optimization.

Sample Customers

Expedia, Intuit, Royal Dutch Shell, Brooks Brothers

Absolutdata, Backflip Studios, Bluecore, Claritics, Crystalloids, Energyworx, GenieConnect, Leanplum, Nomanini, Redbus, Streak, TabTale

Buyer's Guide

Amazon MSK vs. Google Cloud Dataflow

October 2024

Free Report: Amazon MSK vs. Google Cloud Dataflow

Find out what your peers are saying about Amazon MSK vs. Google Cloud Dataflow and other solutions. Updated: October 2024.

DOWNLOAD NOW

816,406 professionals have used our research since 2012.

See our Amazon MSK vs. Google Cloud Dataflow report.

See our list of best Streaming Analytics vendors.

We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.