AWS Glue vs IBM Cloud Pak for Integration comparison

Amazon Web Services (AWS) and IBM are both solutions in the Cloud Data Integration category. Amazon Web Services (AWS) is ranked #1 with an average rating of 7.7, while IBM is ranked #16 with an average rating of 8.5. Amazon Web Services (AWS) holds a 24.8% mindshare in CDI, compared to IBM’s 2.5% mindshare. Additionally, 91% of Amazon Web Services (AWS) users are willing to recommend the solution, compared to 100% of IBM users who would recommend it.

AWS Glue

Read 46 AWS Glue reviews

9,512 Views
6,902 Comparison Views

91% willing to recommend

IBM Cloud Pak for Integration

Read 5 IBM Cloud Pak for Integration reviews

698 Views
525 Comparison Views

100% willing to recommend

AWS Glue

IBM Cloud Pak for Integration

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Dec 3, 2024

AWS Glue and IBM Cloud Pak for Integration are both data integration products, with IBM Cloud Pak showing an advantage due to its extensive capabilities.

Features: AWS Glue provides strong ETL capabilities, automatic schema inference, and smooth integration with other AWS services. Meanwhile, IBM Cloud Pak for Integration offers robust support for various integration patterns, extensive connectors, and a hybrid approach suited for complex enterprise needs.

Room for Improvement: AWS Glue could improve in offering more extensive support beyond the AWS ecosystem and enhancing real-time data processing. Additionally, the user interface can be more intuitive, and it can offer more robust in-built transformation features. IBM Cloud Pak for Integration could benefit from reductions in complexity for initial setup, streamlining licensing costs, and better optimization for small to medium-sized businesses.

Ease of Deployment and Customer Service: AWS Glue provides a serverless, managed model that scales automatically, simplifying its deployment within AWS environments. IBM Cloud Pak for Integration offers flexibility with various cloud environments and on-premise options appealing to hybrid deployments. IBM is known for comprehensive support resources, which could be more advantageous than AWS Glue's support services.

Pricing and ROI: AWS Glue is competitively priced on a pay-as-you-go basis, appealing to those with budget constraints. It offers quick time-to-value. Conversely, IBM Cloud Pak for Integration, while possibly having higher initial costs, offers comprehensive enterprise-grade features that provide a higher ROI, especially in intricate integration scenarios.

To learn more, read our detailed AWS Glue vs. IBM Cloud Pak for Integration Report (Updated: December 2024).

Buyer's Guide

AWS Glue vs. IBM Cloud Pak for Integration

December 2024

Download the complete report

Helped 824,053 peers since 2012

Categories and Ranking

AWS Glue

Ranking in Cloud Data Integration

1st

Average Rating

7.8

Reviews Sentiment

7.0

Number of Reviews

Ranking in other categories

No ranking in other categories

IBM Cloud Pak for Integration

Ranking in Cloud Data Integration

16th

Average Rating

8.6

Reviews Sentiment

7.0

Number of Reviews

Ranking in other categories

API Management (24th)

Mindshare comparison

As of December 2024, in the Cloud Data Integration category, the mindshare of AWS Glue is 24.8%, up from 24.8% compared to the previous year. The mindshare of IBM Cloud Pak for Integration is 2.5%, up from 1.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Cloud Data Integration

Featured Reviews

Ajaykumar Myana

Senior Software Developer at a computer software company with 10,001+ employees

Provides serverless mechanism, easy data transformation and automated infrastructure management

We no longer had to worry much about infrastructure management because AWS Glue is serverless, and Amazon takes care of the underlying infrastructure. This allowed us to focus on the code and application logic without concerns about scaling, CPU management, or handling fluctuations in flow. The serverless nature of Glue jobs relieved us from these infrastructure-related worries.

Read full review

Igor Khalitov

Owner/Full Stack Software Engineer at Maraphonic, Inc.

Manages APIs and integrates microservices with redirection feature

IBM Cloud Pak for Integration includes monitoring capabilities to track the performance and health of your integrations. You can quickly roll back to a previous version if an issue arises. Additionally, it supports incremental deployments, allowing you to shift traffic to a new version of an API gradually. For example, you can start by directing 10% of traffic to the new version while the rest continue using the legacy version. If everything works as expected, you can gradually increase the traffic to the new version over time. IBM Cloud Pak for Integration has a client base that includes numerous organizations using AI and machine learning technologies. We leverage an open-source machine learning framework and integrate it with Kafka to help create and manage various products and data retrieval processes. For companies with private data, the framework first retrieves relevant data from a GitHub database, which is then combined with the final request before being sent to a language model like GPT. This ensures that the language model uses your specific data to generate responses. Kafka plays a key role by streaming real-time data from file systems and databases like Oracle and Microsoft SQL. This data is published to Kafka topics, then vectorized and used with artificial intelligence to enhance the overall process. It's like an old-fashioned approach. The best way is to redesign it with products such as Kafka. Overall, I rate the solution an eight out of ten.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"AWS Glue is very quick to start without cold starts, unlike AWS Lambda."

"AWS Glue is quite better than other tools, but you have to learn it properly before you start using it."

"AWS Glue is a good solution for developers, they have the ability to write code in different languages and other software."

"One aspect that I would like to highlight is the Glue Crawler, which we utilize when working with large datasets to ensure the schema updates seamlessly without requiring end-team knowledge."

"The AWS Glue Data Catalog provides metadata management and schema discovery. AWS Glue simplifies data transformation with automatic schema detection, incremental data updates, and integration with other AWS services."

"I like that it's flexible, powerful, and allows you to write your own queries and scripts to get the needed transformations."

"I appreciate AWS Glue for its cost-effectiveness."

"Data catalog and triggers are the two best features for me. AWS Glue has its own data catalog, which makes it great and really easy to use. Triggers are also really good for scheduling the ETL process."

More AWS Glue pros

"The most valuable aspect of the Cloud Pak, in general, is the flexibility that you have to use the product."

"It is a stable solution."

"Redirection is a key feature. It helps in managing multiple microservices by centralizing control and access."

"Cloud Pak for Integration is definitely scalable. That is the most important criteria."

"The most preferable aspect would be the elimination of the command, which was a significant improvement. In the past, it was a challenge, but now we can proceed smoothly with the implementation of our policies and everything is managed through JCP. It's still among the positive aspects, and it's a valuable feature."

Cons

"The solution's visual ETL tool is of no use for actual implementation."

"There could be an enhanced way of managing pure metadata management or data cataloging."

"AWS Glue's error handling is difficult."

"The monitoring is not that good."

"In terms of performance, if they can further optimize the execution time for serverless jobs, it would be a welcome improvement."

"The solution’s stability could be improved."

"Cost-wise, AWS Glue is expensive, so that's an area for improvement. The process for setting up the solution was also complex, which is another area for improvement."

"If there's a cluster-related configuration, we have to make worker notes, which is quite a headache when processing a large amount of data."

More AWS Glue cons

"Setting up Cloud Pak for Integration is relatively complex. It's not as easy because it has not yet been fully integrated. You still have some products that are still not containerized, so you still have to run them on a dedicated VM."

"The pricing can be improved."

"Enterprise bots are needed to balance products like Kafka and Confluent."

"The initial setup is not easy."

"Its queuing and messaging features need improvement."

Pricing and Cost Advice

"I rate the tool's pricing a four out of ten."

"I rate the tool an eight on a scale of one to ten, where one is expensive, and ten is expensive."

"This solution is affordable and there is an option to pay for the solution based on your usage."

"The pricing is a bit higher than other solutions like Athena and EC2. If the pricing becomes more scaled or flexible, it will be good because you have to pay 44 cents just for one DPU for an hour. If you increase DPUs to 5 or 10, the pricing gets multiplied. There are also some time limits like 0 to 10 minutes or 10 to 20 minutes. If the pricing is according to the minutes, it would be better because you have to limit your job to 10 minutes or 20 minutes."

"I rate pricing an eight out of ten."

"Its price is good. We pay as we go or based on the usage, which is a good thing for us because it is simple to forecast for the tool. It is good in terms of the financial planning of the company, and it is a good way to estimate the cost. It is also simple for our clients. In my opinion, it is one of the best tools in the market for ETL processes because of the fact that you pay as you use, which separates it from other big tools such as PowerCenter, Pentaho Data Integration, and Talend."

"AWS Glue is a paid service that doesn't come under the free trial of AWS."

"AWS Glue is a high-priced solution that bills the client $150,000 to $250,000 annually."

More AWS Glue pricing and cost advice

"The solution's pricing model is very flexible."

"It is an expensive solution."

See which vendors are best for you

Use our free recommendation engine to learn which Cloud Data Integration solutions are best for your needs.

See recommendations

824,053 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

22%

Computer Software Company

13%

Manufacturing Company

Insurance Company

Financial Services Firm

19%

Computer Software Company

14%

Manufacturing Company

10%

Government

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

No data available

Questions from the Community

How do you select the right cloud ETL tool?

AWS Glue and Azure Data factory for ELT best performance cloud services.

See all answers

How does Talend Open Studio compare with AWS Glue?

We reviewed AWS Glue before choosing Talend Open Studio. AWS Glue is the managed ETL (extract, transform, and load) from Amazon Web Services. AWS Glue enables AWS users to create and manage jobs in...

See all answers

What are the most common use cases for AWS Glue?

AWS Glue's main use case is for allowing users to discover, prepare, move, and integrate data from multiple sources. The product lets you use this data for analytics, application development, or ma...

See all answers

What do you like most about IBM Cloud Pak for Integration?

The most preferable aspect would be the elimination of the command, which was a significant improvement. In the past, it was a challenge, but now we can proceed smoothly with the implementation of ...

See all answers

What needs improvement with IBM Cloud Pak for Integration?

Enterprise bots are needed to balance products like Kafka and Confluent.

See all answers

What is your primary use case for IBM Cloud Pak for Integration?

It manages APIs and integrates microservices at the enterprise level. It offers a range of capabilities for handling APIs, microservices, and various integration needs. The platform supports thousa...

See all answers

Comparisons

AWS Database Migration Service vs AWS Glue

Compared 35% of the time

Informatica Intelligent Data Management Cloud (IDMC) vs AWS Glue

Compared 7% of the time

Informatica PowerCenter vs AWS Glue

Compared 6% of the time

SSIS vs AWS Glue

Compared 5% of the time

Talend Open Studio vs AWS Glue

Compared 4% of the time

More AWS Glue Competitors

IBM App Connect vs IBM Cloud Pak for Integration

Compared 44% of the time

IBM API Connect vs IBM Cloud Pak for Integration

Compared 18% of the time

IBM DataPower Gateway vs IBM Cloud Pak for Integration

Compared 8% of the time

MuleSoft API Manager vs IBM Cloud Pak for Integration

Compared 7% of the time

Microsoft Azure API Management vs IBM Cloud Pak for Integration

Compared 7% of the time

More IBM Cloud Pak for Integration Competitors

Product Reports

Buyer's Guide

AWS Glue

December 2024

Download AWS Glue product report

Buyer's Guide

API Management

December 2024

Download IBM Cloud Pak for Integration product report

Learn More

Amazon Web Services (AWS)

IBM

Overview

AWS Glue is a serverless cloud data integration tool that facilitates the discovery, preparation, movement, and integration of data from multiple sources for machine learning (ML), analytics, and application development. The solution includes additional productivity and data ops tooling for running jobs, implementing business workflows, and authoring.

AWS Glue allows users to connect to more than 70 diverse data sources and manage data in a centralized data catalog. The solution facilitates visual creation, running, and monitoring of extract, transform, and load (ETL) pipelines to load data into users' data lakes. This Amazon product seamlessly integrates with other native applications of the brand and allows users to search and query cataloged data using Amazon EMR, Amazon Athena, and Amazon Redshift Spectrum.

The solution also utilizes application programming interface (API) operations to transform users' data, create runtime logs, store job logic, and create notifications for monitoring job runs. The console of AWS Glue connects all of these services into a managed application, facilitating the monitoring and operational processes. The solution also performs provisioning and management of the resources required to run users' workloads in order to minimize manual work time for organizations.

AWS Glue Features

AWS Glue groups its features into four categories - discover, prepare, integrate, and transform. Within those groups are the following features:

Automatic schema discovery: AWS Glue crawlers connect to the organization's source or target data source through a prioritized list of classifiers to determine the schema for users' data. This feature creates metadata in companies' AWS Glue Data Catalog.
Schemas for data stream management: The AWS Glue Schema Registry enables users to validate and control the evolution of streaming data through registered Apache Avro schemas for no additional charge.
Automatic scaling based on workload: This feature dynamically scales resources up and down based on workload. The feature controls job resources, removing them depending on how much the workload can be split up.
FindMatches: This feature is for machine learning-based data deduplication and cleansing, and works by finding records that are imperfect matches of each other to remove useless data copies.
Edit, debug, and test ETL code: This feature helps users who have chosen to interactively develop their ETL code by providing development endpoints for editing, debugging, and testing the code it generates for them.
AWS Glue DataBrew: An interactive, point-and-click visual interface for specialists to clean and normalize data without the need to write any code.
AWS Glue Interactive Sessions: This feature simplifies the development of data integration jobs by enabling data engineers to interactively prepare and explore data.
AWS Glue Studio Job Notebooks: This AWS Glue feature provides serverless notebooks with minimal setup, allowing developers to start working in a timely manner.
Complex ETL pipeline building: This feature allows the product to be invoked on a schedule, on demand, or based on an event, allowing users to start multiple jobs in parallel or specify dependencies to build complex ETL pipelines.
AWS Glue Studio: This AWS Glue feature allows users to visually transform data through a drag-and-drop interface. The product automatically generates the code for ETL processes for users' data.

AWS Glue Benefits

AWS Glue offers a wide range of benefits for its users. These benefits include:

Users of other AWS products can easily onboard with AWS Glue, as it is integrated across a wide range of the company's services.
The solution is serverless, which allows for a lower total cost of ownership.
AWS Glue offers more power for users, as it automates much of the effort in building, maintaining, and running ETL jobs.
The product allows customers to easily discover and search across all their AWS datasets through AWS Glue Data Catalog.
AWS Glue does not require additional payment for managing and enforcing schemas for data streams.
The solution facilitates the authority of scalable ETL jobs for beginners and non-coding experts through a drag-and-drop interface.

Reviews from Real Users

Mustapha A., a cloud data engineer at Jems Groupe, likes AWS Glue because it is a product that is great for serverless data transformations.

Liana I., CEO at Quark Technologies SRL, describes AWS Glue as a highly scalable, reliable, and beneficial pay-as-you-go pricing model.

IBM Cloud Pak for Integration gives you complete, flexible integration using capabilities you need to move at today's speed of business, including the tools to help you achieve your application modernization goals as part of your journey to the cloud.

Sample Customers

bp, Cerner, Expedia, Finra, HESS, intuit, Kellog's, Philips, TIME, workday

CVS Health Corporation

Buyer's Guide

AWS Glue vs. IBM Cloud Pak for Integration

December 2024

Free Report: AWS Glue vs. IBM Cloud Pak for Integration

Find out what your peers are saying about AWS Glue vs. IBM Cloud Pak for Integration and other solutions. Updated: December 2024.

DOWNLOAD NOW

824,053 professionals have used our research since 2012.

See our AWS Glue vs. IBM Cloud Pak for Integration report.

See our list of best Cloud Data Integration vendors.

We monitor all Cloud Data Integration reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.