AWS Glue vs Amazon Data Firehose comparison

Amazon Data Firehose and AWS Glue are both solutions in the Cloud Data Integration category. Amazon Data Firehose is ranked #22 with an average rating of 9.0, while AWS Glue is ranked #1 with an average rating of 7.7. Additionally, 100% of Amazon Data Firehose users are willing to recommend the solution, compared to 91% of AWS Glue users who would recommend it.

Amazon Data Firehose

Read 1 Amazon Data Firehose review

37 Views
35 Comparison Views

100% willing to recommend

AWS Glue

Read 46 AWS Glue reviews

9,512 Views
6,902 Comparison Views

91% willing to recommend

Amazon Data Firehose

AWS Glue

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Amazon Data Firehose and AWS Glue based on real PeerSpot user reviews.

Find out what your peers are saying about Amazon Web Services (AWS), Informatica, Salesforce and others in Cloud Data Integration.

To learn more, read our detailed Cloud Data Integration Report (Updated: December 2024).

Buyer's Guide

Cloud Data Integration

December 2024

Download the complete report

Helped 824,053 peers since 2012

Categories and Ranking

Amazon Data Firehose

Ranking in Cloud Data Integration

22nd

Average Rating

9.0

Reviews Sentiment

8.1

Number of Reviews

Ranking in other categories

No ranking in other categories

AWS Glue

Ranking in Cloud Data Integration

1st

Average Rating

7.8

Reviews Sentiment

7.0

Number of Reviews

Ranking in other categories

No ranking in other categories

Featured Reviews

Johnny Suleiman

MS AWS expert at Bespin Global MEA, an e& enterprise Company

Enhances our AI-driven analytics projects by providing a means to manage data streaming and delivery at any scale

The primary use case of Amazon Data Firehose is for real-time streaming data, specifically for data analysis and collection purposes. It is used to extract useful data and export it for machine learning algorithms to analyze, providing real-time data streaming Amazon Data Firehose enhances our…

Read full review

Ajaykumar Myana

Senior Software Developer at a computer software company with 10,001+ employees

Provides serverless mechanism, easy data transformation and automated infrastructure management

We no longer had to worry much about infrastructure management because AWS Glue is serverless, and Amazon takes care of the underlying infrastructure. This allowed us to focus on the code and application logic without concerns about scaling, CPU management, or handling fluctuations in flow. The serverless nature of Glue jobs relieved us from these infrastructure-related worries.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"The most valuable feature is its capability for real-time data streaming."

"One aspect that I would like to highlight is the Glue Crawler, which we utilize when working with large datasets to ensure the schema updates seamlessly without requiring end-team knowledge."

"I like its integration and ability to handle all data-related tasks."

"Transformations are valuable because you can modify or override complex data logic from an open source or Spark to solve issues."

"Its user interface is quite good. You just need to choose some options to create a job in AWS Glue. The code-generation feature is also useful. If you don't want to customize it and simply want to read a file and store the data in the database, it can generate the code for you."

"It's very good to manage."

"It is a very scalable solution."

"Our entire use case was very easily handled or solved using this solution."

"The AWS Glue Data Catalog provides metadata management and schema discovery. AWS Glue simplifies data transformation with automatic schema detection, incremental data updates, and integration with other AWS services."

More AWS Glue pros

Cons

"Amazon Data Firehose enhances our AI-driven analytics projects by providing a means to manage data streaming and delivery at any scale."

"In terms of performance, if they can further optimize the execution time for serverless jobs, it would be a welcome improvement."

"The solution’s stability could be improved."

"It is not clear how the partition discovery would have been affected by more data coming in."

"There should be more connectors for different databases."

"Cost-wise, AWS Glue is expensive, so that's an area for improvement. The process for setting up the solution was also complex, which is another area for improvement."

"I haven't looked into Glue in terms of seeking out flaws. I've not come across missing features."

"It fails to handle massive databases acquired from various sources."

"The crucial problem with AWS Glue is that it only works with AWS. It is not an agnostic tool like Pentaho. In PowerCenter, we can install the forms from Google and other vendors, but in the case of AWS Glue, we can only use AWS."

More AWS Glue cons

Pricing and Cost Advice

Information not available

"I rate the tool's pricing a four out of ten."

"Technical support is a paid service, and which subscription you have is dependent on that. You must pay one of them, and it ranges from $15,000 to $25,000 per year."

"The pricing is a bit higher than other solutions like Athena and EC2. If the pricing becomes more scaled or flexible, it will be good because you have to pay 44 cents just for one DPU for an hour. If you increase DPUs to 5 or 10, the pricing gets multiplied. There are also some time limits like 0 to 10 minutes or 10 to 20 minutes. If the pricing is according to the minutes, it would be better because you have to limit your job to 10 minutes or 20 minutes."

"It is not expensive. AWS Glue works on the serverless architecture. We get charged for the time the server is up. For our use case, we have to use it once in a day, and it is not expensive for us."

"The overall cost of AWS Glue could be better. It cost approximately $1,000 a month. There is paid support available from AWS Glue."

"AWS Glue follows a pay-as-you-go model, wherein the cost of the data you use will be counted as a monthly bill."

"I rate the tool an eight on a scale of one to ten, where one is expensive, and ten is expensive."

"AWS Glue is a high-priced solution that bills the client $150,000 to $250,000 annually."

More AWS Glue pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Cloud Data Integration solutions are best for your needs.

See recommendations

824,053 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

No data available

Financial Services Firm

22%

Computer Software Company

13%

Manufacturing Company

Insurance Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

No data available

Questions from the Community

What is your experience regarding pricing and costs for Amazon Data Firehose?

The pricing is fair and balanced for the capabilities provided by Amazon Data Firehose.

See all answers

What needs improvement with Amazon Data Firehose?

There is no specific improvement mentioned for Amazon Data Firehose itself. However, it was noted that there could be room for a better understanding of real-time data streaming concepts for junior...

See all answers

What is your primary use case for Amazon Data Firehose?

See all answers

How do you select the right cloud ETL tool?

AWS Glue and Azure Data factory for ELT best performance cloud services.

See all answers

How does Talend Open Studio compare with AWS Glue?

We reviewed AWS Glue before choosing Talend Open Studio. AWS Glue is the managed ETL (extract, transform, and load) from Amazon Web Services. AWS Glue enables AWS users to create and manage jobs in...

See all answers

What are the most common use cases for AWS Glue?

AWS Glue's main use case is for allowing users to discover, prepare, move, and integrate data from multiple sources. The product lets you use this data for analytics, application development, or ma...

See all answers

Comparisons

No data available

AWS Database Migration Service vs AWS Glue

Compared 35% of the time

Informatica Intelligent Data Management Cloud (IDMC) vs AWS Glue

Compared 7% of the time

Informatica PowerCenter vs AWS Glue

Compared 6% of the time

SSIS vs AWS Glue

Compared 5% of the time

Talend Open Studio vs AWS Glue

Compared 4% of the time

More AWS Glue Competitors

Product Reports

Buyer's Guide

Cloud Data Integration

December 2024

Download Amazon Data Firehose product report

Buyer's Guide

AWS Glue

December 2024

Download AWS Glue product report

Learn More

Video not available

Amazon Web Services (AWS)

Overview

Amazon Data Firehose offers a robust data streaming service that simplifies integration and data capture, enabling real-time data processing and analysis efficiently.

Amazon Data Firehose is a cloud-based service providing real-time data streaming into analytics tools like Amazon S3 and Redshift. It offers seamless scalability, enabling consistent delivery, transformation, and enriching capabilities of data streams. Users value its reliability for handling streaming data with minimal administration. It excels in performance for those seeking efficient data management. Still, there is room for enhancement in its pricing model to better cater to businesses with rapid fluctuations in data volume.

What are the key features of Amazon Data Firehose?

Data Transformation: Convert incoming data before delivering to destinations.
Automatic Scaling: Dynamically adjust to handle up to gigabytes of streaming data per second.
Destination Flexibility: Directly integrate with Amazon S3, Redshift, and Elasticsearch.
Data Formatting: Supports compression and format conversions.

What benefits should users expect from Amazon Data Firehose?

Efficient Data Handling: Secure and efficient real-time data processing.
Cost-Effective: Reduces infrastructure and management costs.
Simplified Integration: Easily integrates with storage and analytics services.
Consistent Performance: Reliable delivery even under high data loads.

Amazon Data Firehose finds diverse applications across industries like finance, healthcare, and e-commerce. In finance, it supports fraud detection via real-time data ingestion. Healthcare facilities use it for efficient patient monitoring systems. E-commerce platforms leverage its capabilities for real-time analytics, enhancing customer experiences with tailored offerings.

AWS Glue is a serverless cloud data integration tool that facilitates the discovery, preparation, movement, and integration of data from multiple sources for machine learning (ML), analytics, and application development. The solution includes additional productivity and data ops tooling for running jobs, implementing business workflows, and authoring.

AWS Glue allows users to connect to more than 70 diverse data sources and manage data in a centralized data catalog. The solution facilitates visual creation, running, and monitoring of extract, transform, and load (ETL) pipelines to load data into users' data lakes. This Amazon product seamlessly integrates with other native applications of the brand and allows users to search and query cataloged data using Amazon EMR, Amazon Athena, and Amazon Redshift Spectrum.

The solution also utilizes application programming interface (API) operations to transform users' data, create runtime logs, store job logic, and create notifications for monitoring job runs. The console of AWS Glue connects all of these services into a managed application, facilitating the monitoring and operational processes. The solution also performs provisioning and management of the resources required to run users' workloads in order to minimize manual work time for organizations.

AWS Glue Features

AWS Glue groups its features into four categories - discover, prepare, integrate, and transform. Within those groups are the following features:

Automatic schema discovery: AWS Glue crawlers connect to the organization's source or target data source through a prioritized list of classifiers to determine the schema for users' data. This feature creates metadata in companies' AWS Glue Data Catalog.
Schemas for data stream management: The AWS Glue Schema Registry enables users to validate and control the evolution of streaming data through registered Apache Avro schemas for no additional charge.
Automatic scaling based on workload: This feature dynamically scales resources up and down based on workload. The feature controls job resources, removing them depending on how much the workload can be split up.
FindMatches: This feature is for machine learning-based data deduplication and cleansing, and works by finding records that are imperfect matches of each other to remove useless data copies.
Edit, debug, and test ETL code: This feature helps users who have chosen to interactively develop their ETL code by providing development endpoints for editing, debugging, and testing the code it generates for them.
AWS Glue DataBrew: An interactive, point-and-click visual interface for specialists to clean and normalize data without the need to write any code.
AWS Glue Interactive Sessions: This feature simplifies the development of data integration jobs by enabling data engineers to interactively prepare and explore data.
AWS Glue Studio Job Notebooks: This AWS Glue feature provides serverless notebooks with minimal setup, allowing developers to start working in a timely manner.
Complex ETL pipeline building: This feature allows the product to be invoked on a schedule, on demand, or based on an event, allowing users to start multiple jobs in parallel or specify dependencies to build complex ETL pipelines.
AWS Glue Studio: This AWS Glue feature allows users to visually transform data through a drag-and-drop interface. The product automatically generates the code for ETL processes for users' data.

AWS Glue Benefits

AWS Glue offers a wide range of benefits for its users. These benefits include:

Users of other AWS products can easily onboard with AWS Glue, as it is integrated across a wide range of the company's services.
The solution is serverless, which allows for a lower total cost of ownership.
AWS Glue offers more power for users, as it automates much of the effort in building, maintaining, and running ETL jobs.
The product allows customers to easily discover and search across all their AWS datasets through AWS Glue Data Catalog.
AWS Glue does not require additional payment for managing and enforcing schemas for data streams.
The solution facilitates the authority of scalable ETL jobs for beginners and non-coding experts through a drag-and-drop interface.

Reviews from Real Users

Mustapha A., a cloud data engineer at Jems Groupe, likes AWS Glue because it is a product that is great for serverless data transformations.

Liana I., CEO at Quark Technologies SRL, describes AWS Glue as a highly scalable, reliable, and beneficial pay-as-you-go pricing model.

Sample Customers

Information Not Available

bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday

Buyer's Guide

Cloud Data Integration

December 2024

Download Free Report

Find out what your peers are saying about Amazon Web Services (AWS), Informatica, Salesforce and others in Cloud Data Integration. Updated: December 2024.

DOWNLOAD NOW

824,053 professionals have used our research since 2012.

See our list of best Cloud Data Integration vendors.

We monitor all Cloud Data Integration reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.