Try our new research platform with insights from 80,000+ expert users

Amazon MSK vs Cloudera DataFlow comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Amazon MSK
Ranking in Streaming Analytics
6th
Average Rating
7.4
Number of Reviews
10
Ranking in other categories
No ranking in other categories
Cloudera DataFlow
Ranking in Streaming Analytics
14th
Average Rating
7.2
Reviews Sentiment
6.8
Number of Reviews
4
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of November 2024, in the Streaming Analytics category, the mindshare of Amazon MSK is 9.2%, down from 9.9% compared to the previous year. The mindshare of Cloudera DataFlow is 1.4%, down from 1.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics
 

Featured Reviews

FNU AKSHANSH - PeerSpot reviewer
Streamlines our processes, and we don't need to configure any VPCs; it's automatic
We don't have many use cases involving ingesting large amounts of data and scaling up and down. We have a clear understanding of our data volume, which remains relatively constant throughout the week. While we're aware of other features Amazon MSK offers, we feel confident in our current setup. If our requirements change significantly in the future, we'll reassess our needs and consider adopting Amazon MSK.
Júlio César Gomes Fonseca - PeerSpot reviewer
A stable solution that helps develop quality modules but needs to improve its programming language
The initial setup was not so difficult. The deployment took so long, at least one or two years, because the team has a project that aims to be exceptional in the future. It's good to say because the company is very good. It's a self-confirmation technical integration company. We have numerous reasons why reducing staff workload is beneficial. However, it is important to note that this does not directly apply to the application used. They will only do the service.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable feature of Amazon MSK is the integration."
"Amazon MSK's separation of concerns and ease of creating and deploying new features are highly valuable. It just requires to assign them to the topic, and then anyone who needs to consume these messages can do so directly from Amazon MSK. This separation of concerns makes it very convenient, especially for new feature development, as developers can easily access the messages they need without having to deal with complex server communications or protocol setups."
"MSK has a private network that's an out-of-box feature."
"It offers good stability."
"Amazon MSK has good integration because our team has been undergoing significant changes. Coupling it with MSK within AWS is helpful. We don't have to set up additionals or monitor external environments. This"
"Amazon MSK's scalability is very good."
"Amazon MSK has significantly improved our organization by building seamless integration between systems."
"Overall, it is very cost-effective based on the workflow."
"DataFlow's performance is okay."
"This solution is very scalable and robust."
"The most effective features are data management and analytics."
"The initial setup was not so difficult"
 

Cons

"It would be really helpful if Amazon MSK could provide a single installation that covers all the servers."
"Amazon MSK could improve on the features they offer. They are still lagging behind Confluence."
"It does not autoscale. Because if you do keep it manually when you add a note to the cluster and then you register it, then it is scalable, but the fact that you have to go and do it, I think, makes it, again, a bit of some operational overhead when managing the cluster."
"The product's schema support needs enhancement. It will help enhance integration with many kinds of languages of programming languages, especially for environments using languages like .NET."
"In my opinion, there are areas in Amazon MSK that could be improved, particularly in terms of configuration. Initially setting it up and getting it connected was quite challenging. The naming conventions for policies were updated by AWS, and some were undocumented, leading to confusion with outdated materials. It took us weeks of trial and error before discovering new methods through hidden tutorials and official documentation."
"The configuration seems a little complex and the documentation on the product is not available."
"It should be more flexible, integration-wise."
"Horizontal scale-out is actually not easy, making it an area where improvements are required."
"Although their workflow is pretty neat, it still requires a lot of transformation coding; especially when it comes to Python and other demanding programming languages."
"It's an outdated legacy product that doesn't meet the needs of modern data analysts and scientists."
"It is not easy to use the R language. Though I don't know if it's possible, I believe it is possible, but it is not the best language for machine learning."
 

Pricing and Cost Advice

"The price of Amazon MSK is less than some competitor solutions, such as Confluence."
"When you create a complete enterprise-driven architecture that is deployable on an enterprise scale, I would say that the prices of Amazon MSK and Confluent Platform become comparable."
"The platform has better pricing than one of its competitors."
"DataFlow isn't expensive, but its value for money isn't great."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
816,406 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
21%
Computer Software Company
19%
Manufacturing Company
7%
Retailer
5%
Computer Software Company
20%
Financial Services Firm
16%
University
11%
Manufacturing Company
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What do you like most about Amazon MSK?
Amazon MSK has significantly improved our organization by building seamless integration between systems.
What needs improvement with Amazon MSK?
From AWS, I would consider more MSK schema validation is needed. It is easy to integrate if you have an application, but on-topic integration is more complex. You can do it with EvenBridge very eas...
What is your primary use case for Amazon MSK?
I have used Confluent Cloud and Amazon MSK in my company. We are not using it for analytics and it is more for CDC processes, so we change the capture processes. It is used to extract data from a d...
What do you like most about Cloudera DataFlow?
The most effective features are data management and analytics.
What is your primary use case for Cloudera DataFlow?
We use Cloudera DataFlow for stream analytics.
 

Also Known As

Amazon Managed Streaming for Apache Kafka
CDF, Hortonworks DataFlow, HDF
 

Overview

 

Sample Customers

Expedia, Intuit, Royal Dutch Shell, Brooks Brothers
Clearsense
Find out what your peers are saying about Amazon MSK vs. Cloudera DataFlow and other solutions. Updated: October 2024.
816,406 professionals have used our research since 2012.