Try our new research platform with insights from 80,000+ expert users

Apache Spark Streaming vs Confluent comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 17, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Spark Streaming
Ranking in Streaming Analytics
10th
Average Rating
8.0
Reviews Sentiment
7.4
Number of Reviews
11
Ranking in other categories
No ranking in other categories
Confluent
Ranking in Streaming Analytics
3rd
Average Rating
8.2
Reviews Sentiment
6.8
Number of Reviews
22
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of January 2025, in the Streaming Analytics category, the mindshare of Apache Spark Streaming is 3.4%, down from 4.3% compared to the previous year. The mindshare of Confluent is 8.8%, down from 11.9% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics
 

Featured Reviews

AbhishekGupta - PeerSpot reviewer
Easy integration, beneficial auto-scaling, and good open-sourced support community
The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better. Apache Spark Streaming does not have auto-tuning. A customer needs to invest a lot, in terms of management and maintenance.
Yantao Zhao - PeerSpot reviewer
Great tool for sharing knowledge, internal communication and allows for real-time collaboration on pages
Confluence is easy to use and modify. However, sometimes there are too many pages. We have to reorganize the folder or parent account. Since everyone can create a page, the same knowledge might be created in multiple places by different people. This leads to redundancy and makes it difficult to find information. It's not centralized. So it could be more user-friendly and centralized. A way to reduce redundancy would be helpful. It's very easy to use, so everyone can create knowledge. But it would be good to synchronize and organize that information a bit better. Another improvement would be in Confluence search. You can search for keywords, but it's not like AI, not even ChatGPT or OpenAI. It would be nice to get more relevant or organized answers. If you're outside the company, you just get some titles containing the keyword you input. But if Confluence were like a database, you could input something and get a well-organized search offering from multiple pages.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Apache Spark's capabilities for machine learning are quite extensive and can be used in a low-code way."
"Apache Spark Streaming has features like checkpointing and Streaming API that are useful."
"Spark Streaming is critical, quite stable, full-featured, and scalable."
"It's the fastest solution on the market with low latency data on data transformations."
"The solution is very stable and reliable."
"Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services."
"The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams."
"The solution is better than average and some of the valuable features include efficiency and stability."
"The most valuable feature of Confluent is the wide range of features provided. They're leading the market in this category."
"I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and tools."
"It is also good for knowledge base management."
"With Confluent Cloud we no longer need to handle the infrastructure and the plumbing, which is a concern for Confluent. The other advantage is that all portfolios have access to the data that is being shared."
"One of the best features of Confluent is that it's very easy to search and have a live status with Jira."
"I would rate the scalability of the solution at eight out of ten. We have 20 people who use Confluent in our organization now, and we hope to increase usage in the future."
"The benefit is escaping email communication. Sometimes people ignore emails or put them into spam, but with Confluence, everyone sees the same text at the same time."
"We mostly use the solution's message queues and event-driven architecture."
 

Cons

"It was resource-intensive, even for small-scale applications."
"The initial setup is quite complex."
"The debugging aspect could use some improvement."
"In terms of improvement, the UI could be better."
"The solution itself could be easier to use."
"We don't have enough experience to be judgmental about its flaws."
"The cost and load-related optimizations are areas where the tool lacks and needs improvement."
"We would like to have the ability to do arbitrary stateful functions in Python."
"It requires some application specific connectors which are lacking. This needs to be added."
"Currently, in the early stages, I see a gap on the security side. If you are using the SaaS version, we would like to get a fuller, more secure solution that can be adopted right out of the box. Confluence could do a better job sharing best practices or a reusable pattern that others have used, especially for companies that can not afford to hire professional services from Confluent."
"There is no local support team in Saudi Arabia."
"The Schema Registry service could be improved. I would like a bigger knowledge base of other use cases and more technical forums. It would be good to have more flexible monitoring features added to the next release as well."
"It could have more themes. They should also have more reporting-oriented plugins as well. It would be great to have free custom reports that can be dispatched directly from Jira."
"The formatting aspect within the page can be improved and more powerful."
"The product should integrate tools for incorporating diagrams like Lucidchart. It also needs to improve its formatting features. We also faced issues while granting permissions."
"Areas for improvement include implementing multi-storage support to differentiate between database stores based on data age and optimizing storage costs."
 

Pricing and Cost Advice

"I was using the open-source community version, which was self-hosted."
"On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
"People pay for Apache Spark Streaming as a service."
"Spark is an affordable solution, especially considering its open-source nature."
"On a scale from one to ten, where one is low pricing and ten is high pricing, I would rate Confluent's pricing at five. I have not encountered any additional costs."
"Regarding pricing, I think Confluent is a premium product, but it's hard for me to say definitively if it's overly expensive. We're still trying to understand if the features and reduced maintenance complexity justify the cost, especially as we scale our platform use."
"Confluent is an expensive solution."
"The solution is cheaper than other products."
"It comes with a high cost."
"Confluent has a yearly license, which is a bit high because it's on a per-user basis."
"You have to pay additional for one or two features."
"Confluent is an expensive solution as we went for a three contract and it was very costly for us."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
831,265 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
26%
Computer Software Company
20%
Manufacturing Company
6%
University
5%
Financial Services Firm
19%
Computer Software Company
17%
Manufacturing Company
8%
Retailer
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Apache Spark Streaming?
Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
What needs improvement with Apache Spark Streaming?
We don't have enough experience to be judgmental about its flaws, as we've only used stable features like batch micro-batch. Integration poses no problem; however, I don't use some features and can...
What is your primary use case for Apache Spark Streaming?
We use Spark Streaming in a micro-batch region. It's not a full real-time system, but it offers high performance and low latency.
What do you like most about Confluent?
I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and to...
What is your experience regarding pricing and costs for Confluent?
Regarding pricing, I think Confluent is a premium product, but it's hard for me to say definitively if it's overly expensive. We're still trying to understand if the features and reduced maintenanc...
What needs improvement with Confluent?
One area we've identified that could be improved is the governance and access control to the Kafka topics. We've found some limitations, like a threshold of 10,000 rules per cluster, that make it c...
 

Also Known As

Spark Streaming
No data available
 

Learn More

 

Overview

 

Sample Customers

UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
ING, Priceline.com, Nordea, Target, RBC, Tivo, Capital One, Chartboost
Find out what your peers are saying about Apache Spark Streaming vs. Confluent and other solutions. Updated: January 2025.
831,265 professionals have used our research since 2012.