AWS Glue vs Confluent comparison

Read 23 Confluent reviews

5,755 Views
4,333 Comparison Views

95% willing to recommend

AWS Glue

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Jan 12, 2025

Confluent and AWS Glue are competing products in data integration and streaming. Confluent stands out for scalability and real-time data processing, while AWS Glue excels in cost-effective ETL services.

Features: Confluent uses an Apache Kafka-based architecture for real-time data streaming with features like Kafka Connectors, Schema Registry, and ksqlDB. AWS Glue offers a managed ETL service within the AWS ecosystem, featuring a data catalog, job authoring, and job scheduling.

Room for Improvement: Confluent could improve by lowering its setup costs, simplifying its configuration for less technical users, and enhancing integration with non-Kafka ecosystems. AWS Glue could offer better flexibility outside AWS, improve documentation for complex tasks, and enhance support for real-time streaming.

Ease of Deployment and Customer Service: Confluent offers flexible deployment across cloud, on-premises, and hybrid environments with strong enterprise-level support. AWS Glue integrates seamlessly with AWS infrastructure, providing automatic task scaling and managed deployment, but could be more flexible for non-AWS users.

Pricing and ROI: Confluent involves higher initial costs but offers strong ROI through scalability and advanced features. AWS Glue's pay-as-you-go pricing model allows cost savings when used across AWS services, offering a lower entry cost for standard ETL tasks.

To learn more, read our detailed AWS Glue vs. Confluent Report (Updated: January 2025).

Download the complete report

AWS Glue vs. Confluent

January 2025

Helped 838,713 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

AWS Glue

Average Rating

7.8

Reviews Sentiment

7.0

Number of Reviews

Ranking in other categories

Cloud Data Integration (1st)

Confluent

Average Rating

8.2

Reviews Sentiment

6.7

Number of Reviews

Ranking in other categories

Streaming Analytics (4th)

Featured Reviews

Muthuvel Sivaraman

AVP at a manufacturing company with 10,001+ employees

Handles a huge volume of data and is serverless, but it can be considered costly by some users

We use Amazon's services to provide technical support for the product. If you want to have support, Oracle and others offer a single support, and other tools have a direct support window. For Amazon, we need to pay 10 percent of my billing amount for the tool to get support services. Whether to raise a support ticket or not is an issue since ten percent is a huge amount. My company ends up using all the options without help from support. It is very difficult for any common man to understand why there is a need to pay ten percent for support. If I find an issue in the product, and I need to get support from AWS to fix it, then I need to pay ten percent of the tool's bill amount to Amazon. AWS is a very tricky tool because everything is evolving nowadays. AWS engineers are getting hired from other places, and even after that, if I am not getting any technical support, then things will be very nasty. There are some good engineers who help users outside the normal support cycle, but it doesn't meet their needs. I rate the technical support a four out of ten.

Read full review

Yantao Zhao

Software Integration Engineer at Thales

Great tool for sharing knowledge, internal communication and allows for real-time collaboration on pages

Confluence is easy to use and modify. However, sometimes there are too many pages. We have to reorganize the folder or parent account. Since everyone can create a page, the same knowledge might be created in multiple places by different people. This leads to redundancy and makes it difficult to find information. It's not centralized. So it could be more user-friendly and centralized. A way to reduce redundancy would be helpful. It's very easy to use, so everyone can create knowledge. But it would be good to synchronize and organize that information a bit better. Another improvement would be in Confluence search. You can search for keywords, but it's not like AI, not even ChatGPT or OpenAI. It would be nice to get more relevant or organized answers. If you're outside the company, you just get some titles containing the keyword you input. But if Confluence were like a database, you could input something and get a well-organized search offering from multiple pages.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"The solution is serverless so it allows us to transform data while optimizing the cost and performance of Spark jobs."

"The AWS Glue Data Catalog provides metadata management and schema discovery. AWS Glue simplifies data transformation with automatic schema detection, incremental data updates, and integration with other AWS services."

"One aspect that I would like to highlight is the Glue Crawler, which we utilize when working with large datasets to ensure the schema updates seamlessly without requiring end-team knowledge."

"The product has a valuable feature for data catalog."

"AWS Glue is fast and managed by AWS. Hence, you don't have to worry about capacity and the performance of Glue jobs. It has integrations with other data stores of AWS. The product offers metadata management, logging, and ETL processing capabilities. It comes with a powerful feature, Glue Studio, which helps to do queries interactively within the community. It is a managed service and very secure. Another popular and mature service is S3."

"I also like that you can add custom libraries like JAR files and use them. So, the ability to use a fast processing engine and embed basic jobs easily are significant advantages."

"Transformations are valuable because you can modify or override complex data logic from an open source or Spark to solve issues."

"The solution's technical support is good. Whenever we raise a use case where we face an issue in our company, we get a response from the solution's technical team."

More AWS Glue pros

"Implementing Confluent's schema registry has significantly enhanced our organization's data quality assurance."

"The client APIs are the most valuable feature."

"The documentation process is fast with the tool."

"We ensure seamless management of Kafka through Confluent, allowing all of our Kafka activities to be handled by a third party."

"I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and tools."

"The design of the product is extremely well built and it is highly configurable."

"We mostly use the solution's message queues and event-driven architecture."

"Their tech support is amazing; they are very good, both on and off-site."

More Confluent pros

Cons

"The monitoring is not that good."

"There is a learning curve to this tool."

"The drawbacks associated with the product stem from the fact that, based on the data volume, it can become very costly."

"It is not clear how the partition discovery would have been affected by more data coming in."

"The solution’s stability could be improved."

"The solution should offer features for streaming data in addition to batching data."

"It is very difficult to learn the tool and remember the syntaxes comparatively."

"It fails to handle massive databases acquired from various sources."

More AWS Glue cons

"The Schema Registry service could be improved. I would like a bigger knowledge base of other use cases and more technical forums. It would be good to have more flexible monitoring features added to the next release as well."

"there is room for improvement in the visualization."

"In Confluent, there could be a few more VPN options."

"It requires some application specific connectors which are lacking. This needs to be added."

"It could have more themes. They should also have more reporting-oriented plugins as well. It would be great to have free custom reports that can be dispatched directly from Jira."

"There is a limitation when it comes to seamlessly importing Microsoft documents into Confluent pages, which can be inconvenient for users who frequently work with Microsoft Office tools and need to transition their content to Confluent."

"It could be more user-friendly and centralized. A way to reduce redundancy would be helpful."

"I am not very impressed by Confluent. We continuously face issues, such as Kafka being down and slow responses from the support team."

More Confluent cons

Pricing and Cost Advice

"AWS Glue is a paid service that doesn't come under the free trial of AWS."

"The overall cost of AWS Glue could be better. It cost approximately $1,000 a month. There is paid support available from AWS Glue."

"It is an expensive product. I rate its pricing a nine out of ten."

"If you are using the solution for an enterprise business, it will be expensive."

"The solution's pricing is based on DPUs so it is a good idea to optimize use or it can get expensive."

"AWS Glue is quite costly, especially for small organizations."

"AWS Glue uses a pay-as-you-go approach which is helpful. The price of the overall solution is low and is a great advantage."

"I rate the product's pricing a five on a scale of one to ten, where one is a high price, and ten is a low price."

More AWS Glue pricing and cost advice

"The solution is cheaper than other products."

"On a scale from one to ten, where one is low pricing and ten is high pricing, I would rate Confluent's pricing at five. I have not encountered any additional costs."

"Regarding pricing, I think Confluent is a premium product, but it's hard for me to say definitively if it's overly expensive. We're still trying to understand if the features and reduced maintenance complexity justify the cost, especially as we scale our platform use."

"The pricing model of Confluent could improve because if you have a classic use case where you're going to use all the features there is no plan to reduce the features. You should be able to pick and choose basic services at a reduced price. The pricing was high for our needs. We should not have to pay for features we do not use."

"Confluent is expensive, I would prefer, Apache Kafka over Confluent because of the high cost of maintenance."

"You have to pay additional for one or two features."

"Confluent is highly priced."

"Confluent has a yearly license, which is a bit high because it's on a per-user basis."

More Confluent pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Cloud Data Integration solutions are best for your needs.

See recommendations

838,713 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

22%

Computer Software Company

13%

Manufacturing Company

Insurance Company

Financial Services Firm

19%

Computer Software Company

17%

Manufacturing Company

Insurance Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

How do you select the right cloud ETL tool?

AWS Glue and Azure Data factory for ELT best performance cloud services.

How does Talend Open Studio compare with AWS Glue?

We reviewed AWS Glue before choosing Talend Open Studio. AWS Glue is the managed ETL (extract, transform, and load) from Amazon Web Services. AWS Glue enables AWS users to create and manage jobs in...

What are the most common use cases for AWS Glue?

AWS Glue's main use case is for allowing users to discover, prepare, move, and integrate data from multiple sources. The product lets you use this data for analytics, application development, or ma...

What do you like most about Confluent?

I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and to...

What is your experience regarding pricing and costs for Confluent?

Regarding pricing, I think Confluent is a premium product, but it's hard for me to say definitively if it's overly expensive. We're still trying to understand if the features and reduced maintenanc...

What needs improvement with Confluent?

One area we've identified that could be improved is the governance and access control to the Kafka topics. We've found some limitations, like a threshold of 10,000 rules per cluster, that make it c...

AWS Database Migration Service vs AWS Glue

Comparisons

Compared 36% of the time

Informatica Intelligent Data Management Cloud (IDMC) vs AWS Glue

Compared 6% of the time

SSIS vs AWS Glue

Compared 5% of the time

SnapLogic vs AWS Glue

Compared 5% of the time

Boomi iPaaS vs AWS Glue

Compared 2% of the time

More AWS Glue Competitors

Amazon Kinesis vs Confluent

Compared 16% of the time

Amazon MSK vs Confluent

Compared 12% of the time

Databricks vs Confluent

Compared 8% of the time

Fivetran vs Confluent

Compared 5% of the time

Palantir Foundry vs Confluent

Compared 4% of the time

More Confluent Competitors

Product Reports

Download AWS Glue product report

AWS Glue

February 2025

Download Confluent product report

February 2025

Overview

AWS Glue is a serverless cloud data integration tool that facilitates the discovery, preparation, movement, and integration of data from multiple sources for machine learning (ML), analytics, and application development. The solution includes additional productivity and data ops tooling for running jobs, implementing business workflows, and authoring.

AWS Glue allows users to connect to more than 70 diverse data sources and manage data in a centralized data catalog. The solution facilitates visual creation, running, and monitoring of extract, transform, and load (ETL) pipelines to load data into users' data lakes. This Amazon product seamlessly integrates with other native applications of the brand and allows users to search and query cataloged data using Amazon EMR, Amazon Athena, and Amazon Redshift Spectrum.

The solution also utilizes application programming interface (API) operations to transform users' data, create runtime logs, store job logic, and create notifications for monitoring job runs. The console of AWS Glue connects all of these services into a managed application, facilitating the monitoring and operational processes. The solution also performs provisioning and management of the resources required to run users' workloads in order to minimize manual work time for organizations.

AWS Glue Features

AWS Glue groups its features into four categories - discover, prepare, integrate, and transform. Within those groups are the following features:

Automatic schema discovery: AWS Glue crawlers connect to the organization's source or target data source through a prioritized list of classifiers to determine the schema for users' data. This feature creates metadata in companies' AWS Glue Data Catalog.
Schemas for data stream management: The AWS Glue Schema Registry enables users to validate and control the evolution of streaming data through registered Apache Avro schemas for no additional charge.
Automatic scaling based on workload: This feature dynamically scales resources up and down based on workload. The feature controls job resources, removing them depending on how much the workload can be split up.
FindMatches: This feature is for machine learning-based data deduplication and cleansing, and works by finding records that are imperfect matches of each other to remove useless data copies.
Edit, debug, and test ETL code: This feature helps users who have chosen to interactively develop their ETL code by providing development endpoints for editing, debugging, and testing the code it generates for them.
AWS Glue DataBrew: An interactive, point-and-click visual interface for specialists to clean and normalize data without the need to write any code.
AWS Glue Interactive Sessions: This feature simplifies the development of data integration jobs by enabling data engineers to interactively prepare and explore data.
AWS Glue Studio Job Notebooks: This AWS Glue feature provides serverless notebooks with minimal setup, allowing developers to start working in a timely manner.
Complex ETL pipeline building: This feature allows the product to be invoked on a schedule, on demand, or based on an event, allowing users to start multiple jobs in parallel or specify dependencies to build complex ETL pipelines.
AWS Glue Studio: This AWS Glue feature allows users to visually transform data through a drag-and-drop interface. The product automatically generates the code for ETL processes for users' data.

AWS Glue Benefits

AWS Glue offers a wide range of benefits for its users. These benefits include:

Users of other AWS products can easily onboard with AWS Glue, as it is integrated across a wide range of the company's services.
The solution is serverless, which allows for a lower total cost of ownership.
AWS Glue offers more power for users, as it automates much of the effort in building, maintaining, and running ETL jobs.
The product allows customers to easily discover and search across all their AWS datasets through AWS Glue Data Catalog.
AWS Glue does not require additional payment for managing and enforcing schemas for data streams.
The solution facilitates the authority of scalable ETL jobs for beginners and non-coding experts through a drag-and-drop interface.

Reviews from Real Users

Mustapha A., a cloud data engineer at Jems Groupe, likes AWS Glue because it is a product that is great for serverless data transformations.

Liana I., CEO at Quark Technologies SRL, describes AWS Glue as a highly scalable, reliable, and beneficial pay-as-you-go pricing model.

Amazon Web Services (AWS)

Confluent is an enterprise-ready, full-scale streaming platform that enhances Apache Kafka.

Confluent has integrated cutting-edge features that are designed to enhance these tasks:

Speed up application development and connectivity
Enable transformations through stream processing
Streamline business operations at scale
Adhere to strict architectural standards

Confluent is a more complete distribution of Kafka in that it enhances the integration possibilities of Kafka by introducing tools for managing and optimizing Kafka clusters while providing methods for making sure the streams are secure. Confluent supports publish-and-subscribe as well as the storing and processing of data within the streams. Kafka is easier to operate and build thanks to Confluent.

Confluent's software is available in three different varieties:

A free, open-source streaming platform that makes it simple to start using real-time data streams
An enterprise-grade version of the product with more administrative, ops, and monitoring tools
A premium cloud-based version.

Confluent Advantage Features

Confluent has many valuable key features. Some of the most useful ones include:

Multi-language
- Clients: C++, Python, Go, and .NET
- REST proxy: Can connect to Kafka from any connected network device
- Admin REST APIs: RESTful interface for performing administrator operations

Pre-built ecosystem
- Connectors: More than 100 supported connectors, including S3, Elastic, HDFS, JDBC
- MQTT proxy: Gain access to Kafka from MQTT gateways and devices
- Schema registry: Centralized database to guarantee data compatibility

Streaming database
- ksqlDB: Materialized views and real-time stream processing

GUI management
- Control panel: GUI for scalable Kafka management and monitoring
- Health+: Smart alerts and cloud-based control centers

DevOps automation that is flexible
- Confluent for Kubernetes: Complete API to deploy on Kubernetes
- Automated Ansible deployment on non-containerized environments

Dynamic performance
- Self-balancing clusters: Automated partition re-balancing across brokers in the cluster
- Tiered storage: Older Kafka data offloading to object storage with transparent access

Security that is enterprise-grade
- Role-based access control: Granular user/group access authorization
- Audit logs that are structured: Logs of user actions kept in dedicated Kafka topics
- Secret protection: Sensitive information is encrypted

Global resilience
- Linking clusters: A real-time, highly reliable, and consistent bridge across on-premises and cloud environments
- Multiple-region clusters: Single Kafka cluster with automated client failover distributed across multiple data centers
- Replicator: Asynchronous replication that is based on the Kafka Connect framework

Support
- Round the clock enterprise support from Kafka experts

Reviews from Real Users

Confluent stands out among its competitors for a number of reasons. Two major ones are its robust enterprise support and its open source option. PeerSpot users take note of the advantages of these features in their reviews:

Ravi B., a solutions architect at a tech services company, writes of the solution, “KSQL is a valuable feature, as is the Kafka Connect framework for connecting to the various source systems where you need not write the code. We get great support from Confluent because we're using the enterprise version and whenever there's a problem, they support us with fine-tuning and finding the root cause.”

Amit S., an IT consultant, notes, “The biggest benefit is that it is open source. You have the flexibility of opting or not opting for enterprise support, even though the tool itself is open source.” He adds, “The second benefit is it's very modern and built on Java and Scala. You can extend the features very well, and it doesn't take a lot of effort to do so.”

Sample Customers

bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday

ING, Priceline.com, Nordea, Target, RBC, Tivo, Capital One, Chartboost