AWS Glue vs Confluent comparison

Read 22 Confluent reviews

6,102 Views
4,639 Comparison Views

100% willing to recommend

AWS Glue

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Jan 12, 2025

Confluent and AWS Glue are competing products in data integration and streaming. Confluent stands out for scalability and real-time data processing, while AWS Glue excels in cost-effective ETL services.

Features: Confluent uses an Apache Kafka-based architecture for real-time data streaming with features like Kafka Connectors, Schema Registry, and ksqlDB. AWS Glue offers a managed ETL service within the AWS ecosystem, featuring a data catalog, job authoring, and job scheduling.

Room for Improvement: Confluent could improve by lowering its setup costs, simplifying its configuration for less technical users, and enhancing integration with non-Kafka ecosystems. AWS Glue could offer better flexibility outside AWS, improve documentation for complex tasks, and enhance support for real-time streaming.

Ease of Deployment and Customer Service: Confluent offers flexible deployment across cloud, on-premises, and hybrid environments with strong enterprise-level support. AWS Glue integrates seamlessly with AWS infrastructure, providing automatic task scaling and managed deployment, but could be more flexible for non-AWS users.

Pricing and ROI: Confluent involves higher initial costs but offers strong ROI through scalability and advanced features. AWS Glue's pay-as-you-go pricing model allows cost savings when used across AWS services, offering a lower entry cost for standard ETL tasks.

To learn more, read our detailed AWS Glue vs. Confluent Report (Updated: January 2025).

AWS Glue vs. Confluent

Download the complete report

Helped 831,158 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

AWS Glue

Average Rating

7.8

Reviews Sentiment

7.0

Number of Reviews

Ranking in other categories

Cloud Data Integration (1st)

Confluent

Average Rating

8.2

Reviews Sentiment

6.8

Number of Reviews

Ranking in other categories

Streaming Analytics (3rd)

Featured Reviews

Muthuvel Sivaraman

AVP at a manufacturing company with 10,001+ employees

Handles a huge volume of data and is serverless, but it can be considered costly by some users

We use Amazon's services to provide technical support for the product. If you want to have support, Oracle and others offer a single support, and other tools have a direct support window. For Amazon, we need to pay 10 percent of my billing amount for the tool to get support services. Whether to raise a support ticket or not is an issue since ten percent is a huge amount. My company ends up using all the options without help from support. It is very difficult for any common man to understand why there is a need to pay ten percent for support. If I find an issue in the product, and I need to get support from AWS to fix it, then I need to pay ten percent of the tool's bill amount to Amazon. AWS is a very tricky tool because everything is evolving nowadays. AWS engineers are getting hired from other places, and even after that, if I am not getting any technical support, then things will be very nasty. There are some good engineers who help users outside the normal support cycle, but it doesn't meet their needs. I rate the technical support a four out of ten.

Read full review

Yantao Zhao

Software Integration Engineer at Thales

Great tool for sharing knowledge, internal communication and allows for real-time collaboration on pages

Confluence is easy to use and modify. However, sometimes there are too many pages. We have to reorganize the folder or parent account. Since everyone can create a page, the same knowledge might be created in multiple places by different people. This leads to redundancy and makes it difficult to find information. It's not centralized. So it could be more user-friendly and centralized. A way to reduce redundancy would be helpful. It's very easy to use, so everyone can create knowledge. But it would be good to synchronize and organize that information a bit better. Another improvement would be in Confluence search. You can search for keywords, but it's not like AI, not even ChatGPT or OpenAI. It would be nice to get more relevant or organized answers. If you're outside the company, you just get some titles containing the keyword you input. But if Confluence were like a database, you could input something and get a well-organized search offering from multiple pages.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"You do not need many frameworks to run Glue."

"One aspect that I would like to highlight is the Glue Crawler, which we utilize when working with large datasets to ensure the schema updates seamlessly without requiring end-team knowledge."

"It's very good to manage."

"Transformations are valuable because you can modify or override complex data logic from an open source or Spark to solve issues."

"The best thing about AWS Glue is its scalability and how easy it is to process a large amount of data."

"The solution is serverless so it allows us to transform data while optimizing the cost and performance of Spark jobs."

"The most valuable feature of AWS Glue is scalability."

"Our entire use case was very easily handled or solved using this solution."

More AWS Glue pros

"The most valuable feature of Confluent is the wide range of features provided. They're leading the market in this category."

"One of the best features of Confluent is that it's very easy to search and have a live status with Jira."

"The design of the product is extremely well built and it is highly configurable."

"We mostly use the solution's message queues and event-driven architecture."

"The most valuable feature that we are using is the data replication between the data centers allowing us to configure a disaster recovery or software. However, is it's not mandatory to use and because most of the features that we use are from Apache Kafka, such as end-to-end encryption. Internally, we can develop our own kind of product or service from Apache Kafka."

"It is also good for knowledge base management."

"The most valuable is its capability to enhance the documentation process, particularly when creating software documentation."

"Confluence's greatest asset is its user-friendly interface, coupled with its remarkable ability to seamlessly integrate with a vast range of other solutions."

More Confluent pros

Cons

"AWS Glue's error handling is difficult."

"There could be an enhanced way of managing pure metadata management or data cataloging."

"Improvements in the UI are needed, as it is challenging to understand some functionalities."

"The interface for AWS Glue could improve, they do not put a lot of details. You can write the code, in PySpark or in Scala, which is a big advantage, it is only easy to use for a developer. It will be difficult for new users to enter the cloud environment."

"AWS Glue would be improved by making it easier to switch from single to multi-cloud."

"It is not clear how the partition discovery would have been affected by more data coming in."

"In terms of improvement, the performance of AWS Glue could be faster."

"The price of the solution could improve."

More AWS Glue cons

"The Schema Registry service could be improved. I would like a bigger knowledge base of other use cases and more technical forums. It would be good to have more flexible monitoring features added to the next release as well."

"Confluent has a good monitoring tool, but it's not customizable."

"It requires some application specific connectors which are lacking. This needs to be added."

"there is room for improvement in the visualization."

"It could have more themes. They should also have more reporting-oriented plugins as well. It would be great to have free custom reports that can be dispatched directly from Jira."

"One area we've identified that could be improved is the governance and access control to the Kafka topics. We've found some limitations, like a threshold of 10,000 rules per cluster, that make it challenging to manage access at scale if we have many different data sources."

"It could be more user-friendly and centralized. A way to reduce redundancy would be helpful."

"In Confluent, there could be a few more VPN options."

More Confluent cons

Pricing and Cost Advice

"I rate the tool's pricing a four out of ten."

"AWS Glue is a paid service that doesn't come under the free trial of AWS."

"Technical support is a paid service, and which subscription you have is dependent on that. You must pay one of them, and it ranges from $15,000 to $25,000 per year."

"The current cost is around forty to fifty thousand a month."

"AWS Glue is quite costly, especially for small organizations."

"AWS Glue follows a pay-as-you-go model, wherein the cost of the data you use will be counted as a monthly bill."

"The solution's pricing is based on DPUs so it is a good idea to optimize use or it can get expensive."

"This solution is affordable and there is an option to pay for the solution based on your usage."

More AWS Glue pricing and cost advice

"Confluent has a yearly license, which is a bit high because it's on a per-user basis."

"The pricing model of Confluent could improve because if you have a classic use case where you're going to use all the features there is no plan to reduce the features. You should be able to pick and choose basic services at a reduced price. The pricing was high for our needs. We should not have to pay for features we do not use."

"You have to pay additional for one or two features."

"Confluent is an expensive solution."

"Confluence's pricing is quite reasonable, with a cost of around $10 per user that decreases as the number of users increases. Additionally, it's worth noting that for teams of up to 10 users, the solution is completely free."

"On a scale from one to ten, where one is low pricing and ten is high pricing, I would rate Confluent's pricing at five. I have not encountered any additional costs."

"It comes with a high cost."

"Confluent is an expensive solution as we went for a three contract and it was very costly for us."

More Confluent pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Cloud Data Integration solutions are best for your needs.

See recommendations

831,158 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

22%

Computer Software Company

13%

Manufacturing Company

Insurance Company

Financial Services Firm

19%

Computer Software Company

17%

Manufacturing Company

Insurance Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

How do you select the right cloud ETL tool?

AWS Glue and Azure Data factory for ELT best performance cloud services.

How does Talend Open Studio compare with AWS Glue?

We reviewed AWS Glue before choosing Talend Open Studio. AWS Glue is the managed ETL (extract, transform, and load) from Amazon Web Services. AWS Glue enables AWS users to create and manage jobs in...

What are the most common use cases for AWS Glue?

AWS Glue's main use case is for allowing users to discover, prepare, move, and integrate data from multiple sources. The product lets you use this data for analytics, application development, or ma...

What do you like most about Confluent?

I find Confluent's Kafka Connectors and Kafka Streams invaluable for my use cases because they simplify real-time data processing and ETL tasks by providing reliable, pre-packaged connectors and to...

What is your experience regarding pricing and costs for Confluent?

Regarding pricing, I think Confluent is a premium product, but it's hard for me to say definitively if it's overly expensive. We're still trying to understand if the features and reduced maintenanc...

What needs improvement with Confluent?

One area we've identified that could be improved is the governance and access control to the Kafka topics. We've found some limitations, like a threshold of 10,000 rules per cluster, that make it c...

AWS Database Migration Service vs AWS Glue

Comparisons

Compared 35% of the time

Informatica Intelligent Data Management Cloud (IDMC) vs AWS Glue

Compared 7% of the time

Informatica PowerCenter vs AWS Glue

Compared 5% of the time

SSIS vs AWS Glue

Compared 5% of the time

Palantir Foundry vs AWS Glue

Compared 2% of the time

More AWS Glue Competitors

Amazon Kinesis vs Confluent

Compared 15% of the time

Amazon MSK vs Confluent

Compared 13% of the time

Databricks vs Confluent

Compared 7% of the time

Fivetran vs Confluent

Compared 5% of the time

Aiven Platform vs Confluent

Compared 4% of the time

More Confluent Competitors

Product Reports

AWS Glue

Download AWS Glue product report

Download Confluent product report

Learn More

Amazon Web Services (AWS)

Overview

AWS Glue is a serverless cloud data integration tool that facilitates the discovery, preparation, movement, and integration of data from multiple sources for machine learning (ML), analytics, and application development. The solution includes additional productivity and data ops tooling for running jobs, implementing business workflows, and authoring.

AWS Glue allows users to connect to more than 70 diverse data sources and manage data in a centralized data catalog. The solution facilitates visual creation, running, and monitoring of extract, transform, and load (ETL) pipelines to load data into users' data lakes. This Amazon product seamlessly integrates with other native applications of the brand and allows users to search and query cataloged data using Amazon EMR, Amazon Athena, and Amazon Redshift Spectrum.

The solution also utilizes application programming interface (API) operations to transform users' data, create runtime logs, store job logic, and create notifications for monitoring job runs. The console of AWS Glue connects all of these services into a managed application, facilitating the monitoring and operational processes. The solution also performs provisioning and management of the resources required to run users' workloads in order to minimize manual work time for organizations.

AWS Glue Features

AWS Glue groups its features into four categories - discover, prepare, integrate, and transform. Within those groups are the following features:

Automatic schema discovery: AWS Glue crawlers connect to the organization's source or target data source through a prioritized list of classifiers to determine the schema for users' data. This feature creates metadata in companies' AWS Glue Data Catalog.
Schemas for data stream management: The AWS Glue Schema Registry enables users to validate and control the evolution of streaming data through registered Apache Avro schemas for no additional charge.
Automatic scaling based on workload: This feature dynamically scales resources up and down based on workload. The feature controls job resources, removing them depending on how much the workload can be split up.
FindMatches: This feature is for machine learning-based data deduplication and cleansing, and works by finding records that are imperfect matches of each other to remove useless data copies.
Edit, debug, and test ETL code: This feature helps users who have chosen to interactively develop their ETL code by providing development endpoints for editing, debugging, and testing the code it generates for them.
AWS Glue DataBrew: An interactive, point-and-click visual interface for specialists to clean and normalize data without the need to write any code.
AWS Glue Interactive Sessions: This feature simplifies the development of data integration jobs by enabling data engineers to interactively prepare and explore data.
AWS Glue Studio Job Notebooks: This AWS Glue feature provides serverless notebooks with minimal setup, allowing developers to start working in a timely manner.
Complex ETL pipeline building: This feature allows the product to be invoked on a schedule, on demand, or based on an event, allowing users to start multiple jobs in parallel or specify dependencies to build complex ETL pipelines.
AWS Glue Studio: This AWS Glue feature allows users to visually transform data through a drag-and-drop interface. The product automatically generates the code for ETL processes for users' data.

AWS Glue Benefits

AWS Glue offers a wide range of benefits for its users. These benefits include:

Users of other AWS products can easily onboard with AWS Glue, as it is integrated across a wide range of the company's services.
The solution is serverless, which allows for a lower total cost of ownership.
AWS Glue offers more power for users, as it automates much of the effort in building, maintaining, and running ETL jobs.
The product allows customers to easily discover and search across all their AWS datasets through AWS Glue Data Catalog.
AWS Glue does not require additional payment for managing and enforcing schemas for data streams.
The solution facilitates the authority of scalable ETL jobs for beginners and non-coding experts through a drag-and-drop interface.

Reviews from Real Users

Mustapha A., a cloud data engineer at Jems Groupe, likes AWS Glue because it is a product that is great for serverless data transformations.

Liana I., CEO at Quark Technologies SRL, describes AWS Glue as a highly scalable, reliable, and beneficial pay-as-you-go pricing model.

Confluent is an enterprise-ready, full-scale streaming platform that enhances Apache Kafka.

Confluent has integrated cutting-edge features that are designed to enhance these tasks:

Speed up application development and connectivity
Enable transformations through stream processing
Streamline business operations at scale
Adhere to strict architectural standards

Confluent is a more complete distribution of Kafka in that it enhances the integration possibilities of Kafka by introducing tools for managing and optimizing Kafka clusters while providing methods for making sure the streams are secure. Confluent supports publish-and-subscribe as well as the storing and processing of data within the streams. Kafka is easier to operate and build thanks to Confluent.

Confluent's software is available in three different varieties:

A free, open-source streaming platform that makes it simple to start using real-time data streams
An enterprise-grade version of the product with more administrative, ops, and monitoring tools
A premium cloud-based version.

Confluent Advantage Features

Confluent has many valuable key features. Some of the most useful ones include:

Multi-language
- Clients: C++, Python, Go, and .NET
- REST proxy: Can connect to Kafka from any connected network device
- Admin REST APIs: RESTful interface for performing administrator operations

Pre-built ecosystem
- Connectors: More than 100 supported connectors, including S3, Elastic, HDFS, JDBC
- MQTT proxy: Gain access to Kafka from MQTT gateways and devices
- Schema registry: Centralized database to guarantee data compatibility

Streaming database
- ksqlDB: Materialized views and real-time stream processing

GUI management
- Control panel: GUI for scalable Kafka management and monitoring
- Health+: Smart alerts and cloud-based control centers

DevOps automation that is flexible
- Confluent for Kubernetes: Complete API to deploy on Kubernetes
- Automated Ansible deployment on non-containerized environments

Dynamic performance
- Self-balancing clusters: Automated partition re-balancing across brokers in the cluster
- Tiered storage: Older Kafka data offloading to object storage with transparent access

Security that is enterprise-grade
- Role-based access control: Granular user/group access authorization
- Audit logs that are structured: Logs of user actions kept in dedicated Kafka topics
- Secret protection: Sensitive information is encrypted

Global resilience
- Linking clusters: A real-time, highly reliable, and consistent bridge across on-premises and cloud environments
- Multiple-region clusters: Single Kafka cluster with automated client failover distributed across multiple data centers
- Replicator: Asynchronous replication that is based on the Kafka Connect framework

Support
- Round the clock enterprise support from Kafka experts

Reviews from Real Users

Confluent stands out among its competitors for a number of reasons. Two major ones are its robust enterprise support and its open source option. PeerSpot users take note of the advantages of these features in their reviews:

Ravi B., a solutions architect at a tech services company, writes of the solution, “KSQL is a valuable feature, as is the Kafka Connect framework for connecting to the various source systems where you need not write the code. We get great support from Confluent because we're using the enterprise version and whenever there's a problem, they support us with fine-tuning and finding the root cause.”

Amit S., an IT consultant, notes, “The biggest benefit is that it is open source. You have the flexibility of opting or not opting for enterprise support, even though the tool itself is open source.” He adds, “The second benefit is it's very modern and built on Java and Scala. You can extend the features very well, and it doesn't take a lot of effort to do so.”

Sample Customers

bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday

ING, Priceline.com, Nordea, Target, RBC, Tivo, Capital One, Chartboost

AWS Glue vs. Confluent