Try our new research platform with insights from 80,000+ expert users
Developer Infrastructure at Outbrain
Real User
Very easy to install, stable, and has good scaling options
Pros and Cons
  • "It's very easy to keep to install and it's pretty stable."
  • "The third party is not very stable and sometimes you have problems with this component. There are some developments in newer versions and we're about to try them out, but I'm not sure if it closes the gap."

How has it helped my organization?

In my previous company, we had a proprietary implementation and we changed it with Kafka. We changed it because we had many different connectors available and it also allowed us to create a window to our products for the client. It was an on-premise product and it allowed the outline to take the data out, without us developing anything.

You can connect in any language and there are a lot of connectors available, it helps a lot. And it creates visibility into the data and stability. There are several alternatives but this is one of the best options for this.

What is most valuable?

It's very easy to install and it's pretty stable.

The possibility to have connectors is very helpful. Another valuable aspect is that it's mature and open-source. 

From a scalability point of view, you just add servers and it's scalable. The whole architecture is very scalable.

What needs improvement?

There is a feature that we're currently using called MirrorMaker. We use it to combine the information from different Kafka servers into another server. It's very wide and it gives a very generic scenario. I think it would be great if the possibility would exist out of the box and not as a third party. The third party is not very stable and sometimes you have problems with this component. There are some developments in newer versions and we're about to try them out, but I'm not sure if it closes the gap.

For how long have I used the solution?

I have been using this solution for six months. I also worked with it additionally in my previous company but not so intensively. 

Buyer's Guide
Apache Kafka
March 2025
Learn what your peers think about Apache Kafka. Get advice and tips from experienced pros sharing their opinions. Updated: March 2025.
842,651 professionals have used our research since 2012.

How are customer service and support?

I have never needed to use technical support. I know it's available but we haven't needed it because there's a lot of information on the internet that has helped us to solve our issues. 

What other advice do I have?

I would definitely recommend Kafka. In our current position, we use it to move a lot of data and I think it's definitely working well. I would definitely recommend it.

I would rate it an eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Guirino Ciliberti - PeerSpot reviewer
Data Governance & Lineage Product Manager at Primeur
Real User
Impressive solution with a speedy deployment
Pros and Cons
  • "Deployment is speedy."
  • "It's not possible to substitute IBM MQ with Apache Kafka because the JMS part is not very stable."

What is our primary use case?

Our primary use case for this solution is streaming.

For how long have I used the solution?

We have been using this solution for four years.

What do I think about the stability of the solution?

The solution is stable. However, it's not possible to substitute IBM MQ with Apache Kafka because the JMS part is not very stable. It is inadequate and doesn't have the support of the MQI interface of IBM MQ.

What do I think about the scalability of the solution?

The solution is scalable. Deployment is speedy, but we don't have many installations. We have over a thousand users using this solution and will most likely increase the number of users because we have tested 100,000 messages per second. The solution is impressive.

Which solution did I use previously and why did I switch?

We previously used Mosquitto and Rabbit solutions, but we currently use Apache Kafka.

What's my experience with pricing, setup cost, and licensing?

We are licensed annually for this solution.

What other advice do I have?

I rate this solution a nine out of ten for streaming. I recommend it to other people. The solution is good, but its performance can be improved.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Apache Kafka
March 2025
Learn what your peers think about Apache Kafka. Get advice and tips from experienced pros sharing their opinions. Updated: March 2025.
842,651 professionals have used our research since 2012.
reviewer1304505 - PeerSpot reviewer
Senior Consultant at a tech services company with 51-200 employees
Consultant
Stable, free to use, and offers good stream processing
Pros and Cons
  • "The stream processing is a very valuable aspect of the solution for us."
  • "The solution could always add a few more features to enhance its usage."

What is our primary use case?

Apache Kafka is used for stream processing, metric and log aggregations, and as a message queue for connecting different microservices.

What is most valuable?

The stream processing is a very valuable aspect of the solution for us.

What needs improvement?

Due to the fact that the solution is open source, it has a zookeeper dependency. If I could change anything about the solution, it would be that.

The solution could always add a few more features to enhance its usage.

For how long have I used the solution?

I've been with the company for at least one year, which is for how long I've been using the solution.

What do I think about the stability of the solution?

The stability of the solution is very good, even for large enterprise-level organizations. It's quite reliable. There aren't bugs or glitches that affect it. The solution doesn't crash.

What do I think about the scalability of the solution?

The solution is scalable, however, it's a 50/50 endeavor. It may require some management to build it out.

How are customer service and technical support?

The solution is open source, so there isn't technical support per se. The open-source community that surrounds the technology, however, is very good.

That said, our company provides technical support to our clients if they need it. It's 24/7 support and we try to reply within 20 minutes of receiving a request.

Which solution did I use previously and why did I switch?

Some of our clients are using Apache, while others are using other solutions. It depends on the company and its unique requirements.

How was the initial setup?

The difficulty or simplicity of the initial setup varies. It really depends on the organization and its requirements and infrastructure.

Deployment times vary. It can be up to a week in production, however, with some products online, some services can be deployed within minutes.

When you have already deployed the solution, and it's installed, it doesn't require very much maintenance. If it needs any, my company handles it for our clients. We have an entire team that can work on it.

What's my experience with pricing, setup cost, and licensing?

The solution is open source; it's free to use.

What other advice do I have?

What happens in our company is a little different. We basically provide services to other companies through Kafka, like our management services. It doesn't necessarily mean we're using the solution ourselves, however, we will be going and deploying Kafka for companies, like a systems integrator.

The version of the solution is normally 2.4, however, it depends on the requirements. Our cloud providers are always different due to the fact that the countries that we work with are all different. For example, in the US it could Amazon, Azure, or Google. It varies.

I'd advise other organizations considering using the solution to make sure they understand what the use case is. They need to know what their services will be and if they will be directed to Apache Kafka.

From a customer perspective, potential companies need to make sure they have an idea of how big it's going to be due to the fact that it's a cluster environment. It needs to be taken care of. Customers will need to know things like what is the message rate is which is coming into Kafka and how they will connect all those different microservices or any services together to Kafka.

From an infrastructure perspective, it's more of how big of a cluster a company needs. Who would be the producers to produce it, and who's the consumer who's consuming the data are a few questions that need to be asked.

I'd rate the solution eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Mukulit Bhati - PeerSpot reviewer
CTO at InsightGeeks Solutions Pvt.
Real User
Has amazing throughput, we don't get any delays
Pros and Cons
  • "We get amazing throughput. We don't get any delay."
  • "The manageability should be improved. There are lots of things we need to manage and it should have a function that enables us to manage them all cohesively."

What is most valuable?

We get amazing throughput. We don't get any delay. 

What needs improvement?

The manageability should be improved. There are lots of things we need to manage and it should have a function that enables us to manage them all cohesively. There should be a default property. It's really hard to manage all these things.

For how long have I used the solution?

I have been using Apache Kafka for around six months. 

What do I think about the stability of the solution?

It is really stable. The stability is really good. I just installed it on my local machine. 

What do I think about the scalability of the solution?

It is scalable. 

I use it 24/7. We have to change both packets to Kafka and from Kafka it receives data. We retain the packet for only six seconds.

How are customer service and technical support?

I haven't needed to contact their customer support. It's quite simple. I didn't need to contact them to manage my application. 

How was the initial setup?

It's wasn't so easy for me to deploy. 

What other advice do I have?

My advice would be to go through the documents and understand the topics. Learn what its effects are and take care of partitioning. 

Based on my experience, I would rate it an eight out of ten. It's quite complicated and the configuration requires a lot of effort. As a developer it is quite hard to go into all these things.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
RABBAHMahmoud - PeerSpot reviewer
Senior Technical Architect at RABBAH SOFT
Real User
Top 10
Enables us to move data from static files to a legacy system
Pros and Cons
  • "Scalability is very good."
  • "In the next release, I would like for there to be some authorization and HTL security."

What is our primary use case?

I'm a software architect. The use case will depend my customers. They usually use it for data transfer from static files to a legacy system.

What needs improvement?

In the next release, I would like for there to be some authorization features and HTL security. 

We also need bigger software and better monitoring. 

For how long have I used the solution?

I have been using Apache Kafka for the last ten years. 

What do I think about the stability of the solution?

The stability is good. We've never had any issues. 

What do I think about the scalability of the solution?

Scalability is very good. 

How are customer service and technical support?

I have never needed to contact technical support. My colleagues get support from here, in Morrocco. 

How was the initial setup?

The setup is not a big deal for us. We can handle it. After the system is set up, the person who administers it has to do so with Apache Kafka.

Depending on the setup, it will usually take two weeks.

What other advice do I have?

I would rate it a nine out of ten. Not a ten because of the monitoring and admin improvement I'd like for them to make. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user660591 - PeerSpot reviewer
Senior Java Consultant at a tech services company with 501-1,000 employees
Consultant
The product is a distributed system for persistent messaging

What is most valuable?

The most valuable features are performance, persistent messaging, and reliability. It allows us to persist the message for a configurable number of days, even after it has been delivered to the consumer. The message delivery is also fast.

How has it helped my organization?

We wanted to track the customer activities on our application and store those details on another system(RDBMS/Apache Hadoop). We do extensive analysis with that. This helps the company to analyze the customer activities, such as search terms, and do better.

What needs improvement?

It’s perfect for our requirements.

For how long have I used the solution?

I have been using Apache Kafka for two years.

What do I think about the stability of the solution?

We have had no issues with stability.

What do I think about the scalability of the solution?

We have had no issues with scalability.

How are customer service and technical support?

We use the open source one, so we did not opt for any technical support.

Which solution did I use previously and why did I switch?

We started to use Apache Kafka with our application from scratch.

How was the initial setup?

The initial setup was straightforward. We faced some issues during the development in areas such as message producer and consumer. We rectified those with the tweaking the producer and consumer configurations. The documentation is very good.

What's my experience with pricing, setup cost, and licensing?

I don’t have any idea, as we use the open source version.

What other advice do I have?

It's a high-performance distributed system. If you want to track the user activities or any stream processing, then this is perfect. We have used Docker Kafka for our implementation. It's very easy for setup and testing. You could also try the same.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user578787 - PeerSpot reviewer
Java Developer at a media company with 10,001+ employees
Real User
It provides safety for data in case of node failure or data center outage. Partitioning is useful for parallelizing processing.

What is most valuable?

The most valuable features to me are replication, partitioning and easy integration with Apache Spark, which we use quite a bit for distributed processing.

Replication is good for high availability. It provides additional safety for data in case of node failure or data center outage. Partitioning is a really useful feature for parallelizing processing. We use Apache Spark to process data from a Kafka queue, and Spark is able to assign one executor to each Kafka partition. The more partitions we have, the more threads we can use to process data in parallel. This helps us achieve really good throughput.

How has it helped my organization?

It will help us build a scalable platform. This will allow the company to provide better customer service.

What needs improvement?

It’s pretty easy to use for now. I haven’t had any difficulty or problems that I can complain about. Maybe they can add a UI to the configure queues and to display statistics about data stores.

For how long have I used the solution?

I have used Kafka for about a year.

What do I think about the stability of the solution?

So far, we have not encountered any stability issues.

What do I think about the scalability of the solution?

We have not had any scalability issues. The product is horizontally scalable, so adding extra hardware is all that is needed.

How are customer service and technical support?

We haven’t needed technical support with the product yet.

Which solution did I use previously and why did I switch?

I think performance-wise, the product is very good and fits in our use case. We used other distributed message queues, but all products have their own use case

How was the initial setup?

Initial setup wasn’t really complex. We use Kafka through Hortonworks Suite, which comes with many other big data tools. Ambari makes it easy to setup

What's my experience with pricing, setup cost, and licensing?

Licensing and pricing was handled by my management, so I don’t have much knowledge there.

What other advice do I have?

Give it a try. It’s a valuable, high-performance, distributed processing tool.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1398480 - PeerSpot reviewer
Building Event-centric Data processing Architectures at a tech services company with 51-200 employees
Real User
The product is scalable and provides good connectors, but the ability to connect the producers and consumers must be improved
Pros and Cons
  • "The connectors provided by the solution are valuable."
  • "The ability to connect the producers and consumers must be improved."

What is our primary use case?

We use the solution for analytics for streaming. We also use it for fraud detection.

What is most valuable?

The Kafka Streams library gives quite a bit of functionality. The connectors provided by the solution are valuable.

What needs improvement?

The ability to connect the producers and consumers must be improved. It's still a pain point because a lot of development goes into it.

For how long have I used the solution?

I have been using the solution for seven to eight years.

What do I think about the stability of the solution?

For what it does, the tool is very stable. It is a message broker. It receives the messages and holds them for producers and consumers. It's usually everything around Kafka that has stability problems because Kafka does exactly what it's supposed to do.

What do I think about the scalability of the solution?

Scalability is one of the main selling points of the tool. The additional nodes we add give us the additional storage capacity we need. I rate the scalability a ten out of ten. The solution is used across multiple domains in our organization. I use the product daily. It’s a continuously growing platform.

How are customer service and support?

Apache doesn't provide support. There are sites we can go to for information, but there's no support team for Apache. There are companies like Confluent and HPE that provide support for the solution.

Which solution did I use previously and why did I switch?

We also use Flink and other streaming tools. We use Apache Kafka in addition to other technologies because of the requirement and the business use cases.

How was the initial setup?

It is super easy to set up. I rate the ease of setup a ten out of ten. However, building and administration get quite difficult. It takes three months to make things production-ready.

What about the implementation team?

The deployment was done in-house. We used the tools that we have in our CI/CD pipeline. We needed three people for the deployment. The infrastructure team maintains the tool. The infrastructure team has three to ten members.

What was our ROI?

We see an ROI on the product. If we don't have a tool to buffer the amount of traffic coming in from high-traffic sites, we cannot use the data. Apache Kafka gives us a resting area where we can push as much information as we want to. It’s picked up by consumers when they need it.

It’s a huge return on investment. Otherwise, we must have a system tied to the producer waiting for the consumer to consume before we can do anything with the rest of the messages. A solution like Kafka provides us with a buffer to consume the data as we choose to.

What's my experience with pricing, setup cost, and licensing?

The price depends on who we are getting the product from. If we buy it from Confluent, we always have to try to negotiate the price. The price is always negotiable.

What other advice do I have?

Overall, I rate the product a six out of ten.

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user