Apache Kafka is used for connecting components between each other in the same application. The use is quite limited, but I was curious about its filtering capability of it.
Software Support & Development Engineer at a computer software company with 501-1,000 employees
Scalable and free to use
Pros and Cons
- "Apache Kafka is scalable. It is easy to add brokers."
- "Apache Kafka can improve by making the documentation more user-friendly. It would be beneficial if we could explain to customers in more detail how the solution operates but the documentation get highly technical quickly. For example, if they had a simple page where we can show the customers how it works without the need for the customer to have a computer science background."
What is our primary use case?
How has it helped my organization?
We implemented the notification system between our components, and we found that Apache Kafka performs well in scalability. It has improved our organization because of the scalability and the comfort of a fail-safe or disaster recovery it provides.
What needs improvement?
Apache Kafka can improve by making the documentation more user-friendly. It would be beneficial if we could explain to customers in more detail how the solution operates but the documentation get highly technical quickly. For example, if they had a simple page where we can show the customers how it works without the need for the customer to have a computer science background.
For how long have I used the solution?
I have been using Apache Kafka for approximately two years.
Buyer's Guide
Apache Kafka
January 2025
Learn what your peers think about Apache Kafka. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
829,634 professionals have used our research since 2012.
What do I think about the scalability of the solution?
Apache Kafka is scalable. It is easy to add brokers.
We have approximately 30 people using this solution in my organization. They use the solution daily.
Which solution did I use previously and why did I switch?
I have only used Apache Kafka.
How was the initial setup?
The initial setup of Apache Kafka took some time but after it was easy.
I rate the initial setup of Apache Kafka a three out of five.
What about the implementation team?
We set up the solution in-house.
What's my experience with pricing, setup cost, and licensing?
This is an open-source solution and is free to use.
What other advice do I have?
We have not used the solution in production. We do not have a lot of data at the moment.
I would recommend this solution to others.
I rate Apache Kafka an eight out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Consultant at a tech services company with 51-200 employees
Stable, free to use, and offers good stream processing
Pros and Cons
- "The stream processing is a very valuable aspect of the solution for us."
- "The solution could always add a few more features to enhance its usage."
What is our primary use case?
Apache Kafka is used for stream processing, metric and log aggregations, and as a message queue for connecting different microservices.
What is most valuable?
The stream processing is a very valuable aspect of the solution for us.
What needs improvement?
Due to the fact that the solution is open source, it has a zookeeper dependency. If I could change anything about the solution, it would be that.
The solution could always add a few more features to enhance its usage.
For how long have I used the solution?
I've been with the company for at least one year, which is for how long I've been using the solution.
What do I think about the stability of the solution?
The stability of the solution is very good, even for large enterprise-level organizations. It's quite reliable. There aren't bugs or glitches that affect it. The solution doesn't crash.
What do I think about the scalability of the solution?
The solution is scalable, however, it's a 50/50 endeavor. It may require some management to build it out.
How are customer service and technical support?
The solution is open source, so there isn't technical support per se. The open-source community that surrounds the technology, however, is very good.
That said, our company provides technical support to our clients if they need it. It's 24/7 support and we try to reply within 20 minutes of receiving a request.
Which solution did I use previously and why did I switch?
Some of our clients are using Apache, while others are using other solutions. It depends on the company and its unique requirements.
How was the initial setup?
The difficulty or simplicity of the initial setup varies. It really depends on the organization and its requirements and infrastructure.
Deployment times vary. It can be up to a week in production, however, with some products online, some services can be deployed within minutes.
When you have already deployed the solution, and it's installed, it doesn't require very much maintenance. If it needs any, my company handles it for our clients. We have an entire team that can work on it.
What's my experience with pricing, setup cost, and licensing?
The solution is open source; it's free to use.
What other advice do I have?
What happens in our company is a little different. We basically provide services to other companies through Kafka, like our management services. It doesn't necessarily mean we're using the solution ourselves, however, we will be going and deploying Kafka for companies, like a systems integrator.
The version of the solution is normally 2.4, however, it depends on the requirements. Our cloud providers are always different due to the fact that the countries that we work with are all different. For example, in the US it could Amazon, Azure, or Google. It varies.
I'd advise other organizations considering using the solution to make sure they understand what the use case is. They need to know what their services will be and if they will be directed to Apache Kafka.
From a customer perspective, potential companies need to make sure they have an idea of how big it's going to be due to the fact that it's a cluster environment. It needs to be taken care of. Customers will need to know things like what is the message rate is which is coming into Kafka and how they will connect all those different microservices or any services together to Kafka.
From an infrastructure perspective, it's more of how big of a cluster a company needs. Who would be the producers to produce it, and who's the consumer who's consuming the data are a few questions that need to be asked.
I'd rate the solution eight out of ten.
Which deployment model are you using for this solution?
Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Apache Kafka
January 2025
Learn what your peers think about Apache Kafka. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
829,634 professionals have used our research since 2012.
Enterprice Architect
A reliable message delivery system, but more connectors to different systems are needed
Pros and Cons
- "The most important feature for me is the guaranteed delivery of messages from producers to consumers."
- "More adapters for connecting to different systems need to be available."
What is our primary use case?
I am an enterprise architect involved in Big Data and integration projects using Apache Kafa. We use it for integrating our different management systems.
What is most valuable?
The most important feature for me is the guaranteed delivery of messages from producers to consumers.
What needs improvement?
More adapters for connecting to different systems need to be available.
For how long have I used the solution?
I have been using Kafka for about six months.
What do I think about the stability of the solution?
This is a stable solution and we haven't had any complexities.
What do I think about the scalability of the solution?
This solution is scalable.
Which solution did I use previously and why did I switch?
I have used IBM MQ and it is better in terms of the adapters that are available. However, the price of IBM MQ is very high.
How was the initial setup?
The initial setup is easy.
What's my experience with pricing, setup cost, and licensing?
Kafka is more reasonably priced than IBM MQ.
What other advice do I have?
Although we are deployed on-premises at the moment, we are looking to have a cloud-based deployment in a year or two.
This is a solution that I can recommend but it will take a lot of time to develop the adapters.
I would rate this solution a seven out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
SDET II at a tech services company with 5,001-10,000 employees
Replication and partitioning are valuable features.
What is most valuable?
- Replication, partitioning, and reliability are the most valuable features.
- Even if one of my clusters fails, the replication factor of a topic makes sure that I have the data available for processing, so I won't lose any of it.
- Partitioning enables me to process the parallel requests. It helps in reaching the throughput.
What needs improvement?
One improvement is in regards to the OS memory management. In case there are too many partitions, it runs into memory issues. Although this is a very rare scenario, it can happen.
For how long have I used the solution?
I have been using this product for a year now.
What do I think about the stability of the solution?
There were no stability issues.
What do I think about the scalability of the solution?
Kafka is a highly scalable product. We have not faced any scalability issues so far.
How is customer service and technical support?
Since it's an open source product, no technical support is available. However, the open source community is very active.
How was the initial setup?
The initial setup was straightforward. Just go through the Kafka documentation and it will be up and running in no time.
What's my experience with pricing, setup cost, and licensing?
Since it's an open source product, there is no pricing for it.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Java Architect at a tech vendor with 51-200 employees
The speed at which it publishes messages is valuable.
Pros and Cons
- "Excellent speeds for publishing messages faster."
- "Too much dependency on the zookeeper and leader selection is still the bottleneck for Kafka implementation."
What is most valuable?
Excellent speeds for publishing messages faster.
What needs improvement?
Too much dependency on the zookeeper and leader selection is still the bottleneck for Kafka implementation.
What do I think about the scalability of the solution?
RESTful API implementation actually uses the Kafka Broker to publish the messages but I am not able to find it becoming scalable. Partially, the reason might be there is no load balancer for the RESTful API web server.
How was the initial setup?
Setup is very much straightforward for development, and cluster setup is also easy. I am not aware of the production setup yet.
What about the implementation team?
I implemented it on my own.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Solutions Architect at a tech services company with 201-500 employees
Good support, stable, and it supports a high volume of data
Pros and Cons
- "The most valuable feature is the support for a high volume of data."
- "The initial setup and deployment could be less complex."
What is our primary use case?
We are a solution provider and Apache Kafka is being used in our client's company.
What is most valuable?
The most valuable feature is the support for a high volume of data.
What needs improvement?
The initial setup and deployment could be less complex.
Integration is one of the main concerns that we have.
For how long have I used the solution?
We have been using Apache Kafka for two years.
What do I think about the stability of the solution?
Kafka is a stable product.
What do I think about the scalability of the solution?
This is a scalable solution.
How are customer service and technical support?
The technical support is quite good, and we have no problem with it.
Which solution did I use previously and why did I switch?
We also use IBM MQ. It is also a stable product.
IBM MQ is probably easier to deploy than Kafka.
In addition to these, I have also worked with RabbitMQ.
How was the initial setup?
Deploying Kafka is more complex than IBM MQ.
Which other solutions did I evaluate?
My customer has asked me to choose between IBM MQ and Apache Kafka. I will be comparing these two solutions in the near future. My impression is that Kafka is going to better suit my customer, but I have to consider their specific needs before I can be sure.
What other advice do I have?
This is a solution that I may recommend, but its suitability depends on the needs and requirements.
I would rate this solution an eight out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Apache Kafka Report and get advice and tips from experienced pros
sharing their opinions.
Updated: January 2025
Product Categories
Streaming AnalyticsPopular Comparisons
PubSub+ Platform
Buyer's Guide
Download our free Apache Kafka Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- Which ETL tool would you recommend to populate data from OLTP to OLAP?
- What are the differences between Apache Kafka and IBM MQ?
- How do you select the right cloud ETL tool?
- What is the best streaming analytics tool?
- What are the benefits of streaming analytics tools?
- What features do you look for in a streaming analytics tool?
- When evaluating Streaming Analytics, what aspect do you think is the most important to look for?
- Why is Streaming Analytics important for companies?