Amazon Kinesis and Amazon MSK are prominent streaming data solutions in the AWS ecosystem. While Amazon Kinesis is often praised for its simplicity and quick deployment, Amazon MSK holds an advantage for users requiring extensive Kafka compatibility and operational flexibility.
Features: Amazon Kinesis offers a fully managed service for real-time data processing with features such as auto-scaling, multi-partitioning, and easy integration with AWS services like S3 and Lambda. Amazon MSK stands out for its deep integration with the Kafka ecosystem, robust support for real-time analytics, and native Kafka managed services, providing flexibility for large workloads and smooth development environments.
Room for Improvement: Amazon Kinesis could improve by simplifying data sharding, raising default throttling limits, and enhancing multi-consumer data access. Kinesis may also face challenges outside of the AWS ecosystem. Amazon MSK users express a need for smoother integrations, more configuration flexibility, and better support for external plugins.
Ease of Deployment and Customer Service: Amazon Kinesis is known for its rapid implementation within the AWS environment, offering reasonable customer support with quick response times, though sometimes lacking in depth. Amazon MSK also offers flexible deployment but may require more initial configuration due to its Kafka base. Its technical support receives good feedback, but there is room for increased efficiency and responsiveness.
Pricing and ROI: Amazon Kinesis is seen as cost-effective with a clear pricing structure, though costs can increase with heavy usage. Users highlight significant ROI from reduced infrastructure overhead. Amazon MSK may have higher initial costs for small-scale deployments but offers competitive pricing for larger workloads, providing substantial savings compared to self-managed Kafka clusters.
With Lambda, there is no need for data transfer charges, which is beneficial for less frequent workloads.
We receive prompt support from AWS solution architects or TAMs.
They can manage most of our queries, and for what they cannot manage, they guide us through the process of finding out.
Amazon's support is excellent.
Amazon Kinesis provides auto-scaling with streams that handle large volumes well.
I would rate the scalability of Amazon Kinesis as a nine.
The functionality for scaling comes out of the box and is very effective.
As a B2B enterprise client, our clientele consists of large ticket clients but low amounts of users.
I would rate the stability of Amazon Kinesis as high, giving it a 10.
It doesn't require any maintenance on my end yet, as I haven't had any issues.
There is no lack of functions in Amazon Kinesis. Functionality-wise, we feel it's complete.
Amazon Kinesis could improve its pricing to be more competitive, especially for large volumes.
There are preset configurations and limited configurations that we can set for our unique use case.
I had to remove and drop all the clusters and recreate them again, which is complicated in a production environment.
The increase in cloud costs by 50% to 60% does not justify the savings.
Amazon Kinesis and Lambda pricing is competitive, but we noticed that scaling and large volumes could potentially increase costs significantly.
We use Kafka M5 Large instance, and depending on the instances, that is the cost we have, along with storage cost and data transfer costs.
Once we started using Kafka, our cloud costs rose by 50% to 60%.
Lambda's scalability, seamless integration with other AWS services, and support for multiple programming languages are very beneficial.
Amazon Kinesis integrates easily with the AWS environment.
The scalability and usability are quite remarkable.
The best features of Amazon MSK are the real-time analytics that are excellent.
It starts checking how the brokers are functioning, and automatically, Amazon MSK tries to resolve all the problems.
| Product | Mindshare (%) |
|---|---|
| Amazon Kinesis | 4.5% |
| Amazon MSK | 4.3% |
| Other | 91.2% |
| Company Size | Count |
|---|---|
| Small Business | 8 |
| Midsize Enterprise | 10 |
| Large Enterprise | 9 |
| Company Size | Count |
|---|---|
| Small Business | 4 |
| Midsize Enterprise | 7 |
| Large Enterprise | 4 |
Amazon Kinesis provides real-time data streaming with seamless AWS integration, ideal for analytics, data transformation, and external customer feeds. It offers cost-effective data management with high throughput and low latency, supporting multiple programming languages.
Amazon Kinesis enables organizations to manage real-time data streams efficiently. Its integration with AWS ensures seamless setup and operation, while features like auto-scaling and fault tolerance make it reliable for diverse data sources such as IoT devices and server logs. The platform's ability to handle large-scale event-driven systems and dynamic workloads makes it suitable for complex streaming architectures. Despite some challenges with costs and setup complexity, Kinesis remains a popular choice for its efficient data management and processing capabilities.
What are the key features of Amazon Kinesis?In industries such as IoT, finance, and entertainment, Amazon Kinesis facilitates the real-time ingestion and processing of data streams. It connects seamlessly to data lakes and warehouses, enabling businesses to harness data-driven insights without performance loss. This capability is essential for managing dynamic workloads and large-scale event systems. By supporting tools like KDS, Firehose, and Video Streams, Kinesis empowers organizations to respond quickly to changing data environments, enhancing operational effectiveness across different sectors.
Amazon MSK offers seamless AWS integration, simplifying development and operation. It supports efficient data streaming and ensures cost-effective scalability without additional setup needs.
Amazon MSK stands out for its effortless creation, deployment, and access to new features without complex VPC configurations. Automating scalability, it demands minimal intervention, making it ideal for high-volume workflows. Developers benefit from real-time analytics, event sourcing, and log ingestion, aiding in dashboard maintenance and user log tracking. However, integration challenges exist as some face inflexibility, intricate configurations, and plugin development difficulties. Schema validation, connector variety, and complex update processes lead some to seek alternatives. Noteworthy for order data streaming, transaction tracking in retail and banking, and other real-time data applications, Amazon MSK remains attractive despite high cost concerns.
What are Amazon MSK's key features?In retail and banking, Amazon MSK facilitates order data streaming and transaction tracking. Its capabilities in supporting CDC pipelines, high-volume data management, and asynchronous processes make it favorable for integrating systems, streaming IoT data, and managing dashboard flows. Challenges in integration and configuration persist, nudging users to explore different options in certain contexts.
We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
