Try our new research platform with insights from 80,000+ expert users

StreamSets pros and cons

Vendor: IBM

4.2 out of 5

22 reviews
100% willing to recommend

531 followers

Pros & Cons summary

StreamSets facilitates efficient management of data pipelines with numerous connectors for seamless transfer and integration, offering strong ETL capabilities in Docker and Kubernetes environments. While it excels in resilience against data drift, challenges exist with integrations beyond Java, multi-table SAP HANA support, and complex logging. The platform's technical documentation is often inadequate, and users report latency with its execution engine and cloud server speed, particularly on services like Google Cloud.

Buyer's Guide

Get pricing advice, tips, use cases and valuable features from real users of this product.

Prominent pros & cons

PROS

StreamSets offers a seamless data pipelines setup and provides efficient data transfer, which reduces time by approximately 45 minutes per pipeline or table.

The data drift resilience feature enhances the handling of schema or data type changes, allowing automatic data lake ingestion and maintaining the integrity of downstream pipelines.

StreamSets includes Data Collector and Control Hub, which are user-friendly and effective for non-technical users to build data pipelines and connect to databases easily.

StreamSets provides extensive ETL capabilities, enabling the extraction and transformation of data from multiple sources smoothly, with support for connecting via integration with platforms like Apache Kafka, AWS, and Google Cloud.

StreamSets offers numerous ready connectors and allows for easy customization and integration, making it highly adaptable for large organizations and compatible with various data sources.

CONS

StreamSets needs better integration with non-Java platforms like .NET and better real-time processing capabilities.

Memory leaks and insufficient logging mechanisms are issues, alongside inadequate support for SAP HANA multi-table reading.

StreamSets design experience and documentation require enhancement, as new updates lack clear configuration guidance.

Long processing times with JDBC Lookup and inadequate cloud storage server speed contribute to operational inefficiencies.

Technical support renders slow responses, often taking 48-72 hours to address critical issues, indicating a need for improvement.

StreamSets Pros review quotes

Karthik Rajamani

Principal Engineer at Tata Consultancy Services

Jun 14, 2022

I have used Data Collector, Transformer, and Control Hub products from StreamSets. What I really like about these products is that they're very user-friendly. People who are not from a technological or core development background find it easy to get started and build data pipelines and connect to the databases. They would be comfortable like any technical person within a couple of weeks.

Read full review

Technical Lead at Sopra Steria

May 15, 2022

StreamSets’ data drift resilience has reduced the time it takes us to fix data drift breakages. For example, in our previous Hadoop scenario, when we were creating the Sqoop-based processes to move data from source to destinations, we were getting the job done. That took approximately an hour to an hour and a half when we did it with Hadoop. However, with the StreamSets, since it works on a data collector-based mechanism, it completes the same process in 15 minutes of time. Therefore, it has saved us around 45 minutes per data pipeline or table that we migrate. Thus, it reduced the data transfer, including the drift part, by 45 minutes.

Read full review

SS

Srinivasan Sankar

Senior Data Engineer at a energy/utilities company with 1,001-5,000 employees

Jun 9, 2022

StreamSets data drift feature gives us an alert upfront so we know that the data can be ingested. Whatever the schema or data type changes, it lands automatically into the data lake without any intervention from us, but then that information is crucial to fix for downstream pipelines, which process the data into models, like Tableau and Power BI models. This is actually very useful for us. We are already seeing benefits. Our pipelines used to break when there were data drift changes, then we needed to spend about a week fixing it. Right now, we are saving one to two weeks. Though, it depends on the complexity of the pipeline, we are definitely seeing a lot of time being saved.

Read full review

Free Report: StreamSets Reviews and More

Learn what your peers think about StreamSets. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.

824,053 professionals have used our research since 2012.

Product Manager at a hospitality company with 51-200 employees

May 17, 2023

The ability to have a good bifurcation rate and fewer mistakes is valuable.

Read full review

reviewer1889181

Data Engineer at a consultancy with 11-50 employees

Jun 21, 2022

In StreamSets, everything is in one place.

Read full review

reviewer2067186

Product Marketer at a media company with 1,001-5,000 employees

Jan 6, 2023

The entire user interface is very simple and the simplicity of creating pipelines is something that I like very much about it. The design experience is very smooth.

Read full review

Kevin Kathiem Mutunga

Chief software engineer at Appnomu Business Services

Mar 24, 2023

The best feature that I really like is the integration.

Read full review

Product Marketing Manager at Samsung

Jan 6, 2023

For me, the most valuable features in StreamSets have to be the Data Collector and Control Hub, but especially the Data Collector. That feature is very elegant and seamlessly works with numerous source systems.

Read full review

MI

Software Engineer at Soft Hostings Limited

Sep 18, 2024

What I love the most is that StreamSets is very light. It's a containerized application. It's easy to use with Docker. If you are a large organization, it's very easy to use Kubernetes.

Read full review

AI Engineer at Techvanguard

Dec 4, 2022

The most valuable would be the GUI platform that I saw. I first saw it at a special session that StreamSets provided towards the end of the summer. I saw the way you set it up and how you have different processes going on with your data. The design experience seemed to be pretty straightforward to me in terms of how you drag and drop these nodes and connect them with arrows.

Read full review

Show 10 more reviews (out of 22)

StreamSets Cons review quotes

Karthik Rajamani

Principal Engineer at Tata Consultancy Services

Jun 14, 2022

We create pipelines or jobs in StreamSets Control Hub. It is a great feature, but if there is a way to have a folder structure or organize the pipelines and jobs in Control Hub, it would be great. I submitted a ticket for this some time back.

Read full review

Technical Lead at Sopra Steria

May 15, 2022

The logging mechanism could be improved. If I am working on a pipeline, then create a job out of it and it is running, it will generate constant logs. So, the logging mechanism could be simplified. Now, it is a bit difficult to understand and filter the logs. It takes some time.

Read full review

SS

Srinivasan Sankar

Senior Data Engineer at a energy/utilities company with 1,001-5,000 employees

Jun 9, 2022

Currently, we can only use the query to read data from SAP HANA. What we would like to see, as soon as possible, is the ability to read from multiple tables from SAP HANA. That would be a really good thing that we could use immediately. For example, if you have 100 tables in SQL Server or Oracle, then you could just point it to the schema or the 100 tables and ingestion information. However, you can't do that in SAP HANA since StreamSets currently is lacking in this. They do not have a multi-table feature for SAP HANA. Therefore, a multi-table origin for SAP HANA would be helpful.

Read full review

Free Report: StreamSets Reviews and More

Learn what your peers think about StreamSets. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.

824,053 professionals have used our research since 2012.

Product Manager at a hospitality company with 51-200 employees

May 17, 2023

One thing that I would like to add is the ability to manually enter data. The way the solution currently works is we don't have the option to manually change the data at any point in time. Being able to do that will allow us to do everything that we want to do with our data. Sometimes, we need to manually manipulate the data to make it more accurate in case our prior bifurcation filters are not good. If we have the option to manually enter the data or make the exact iterations on the data set, that would be a good thing.

Read full review

reviewer1889181

Data Engineer at a consultancy with 11-50 employees

Jun 21, 2022

If you use JDBC Lookup, for example, it generally takes a long time to process data.

Read full review

reviewer2067186

Product Marketer at a media company with 1,001-5,000 employees

Jan 6, 2023

One area for improvement could be the cloud storage server speed, as we have faced some latency issues here and there.

Read full review

Kevin Kathiem Mutunga

Chief software engineer at Appnomu Business Services

Mar 24, 2023

Visualization and monitoring need to be improved and refined.

Read full review

Product Marketing Manager at Samsung

Jan 6, 2023

In terms of the product, I don't think there is any room for improvement because it is very good. One small area of improvement that is very much needed is on the knowledge base side. Sometimes, it is not very clear how to set up a certain process or a certain node for a person who's using the platform for the first time.

Read full review

MI

Software Engineer at Soft Hostings Limited

Sep 18, 2024

There aren't enough hands-on labs, and debugging is also an issue because it takes a lot of time. Logs are not that clear when you are debugging, and you can only select a single source for a pipeline.

Read full review

AI Engineer at Techvanguard

Dec 4, 2022

The execution engine could be improved. When I was at their session, they were using some obscure platform to run. There is a controller, which controls what happens on that, but you should be able to easily do this at any of the cloud services, such as Google Cloud. You shouldn't have any issues in terms of how to run it with their online development platform or design platform, basically their execution engine. There are issues with that.

Read full review

Show 10 more reviews (out of 22)

Product Categories

Product Categories

Data Integration

Popular Comparisons

Popular Comparisons

Informatica Intelligent Data Management Cloud (IDMC) vs StreamSets

Azure Data Factory vs StreamSets

Informatica PowerCenter vs StreamSets

SSIS vs StreamSets

Oracle Data Integrator (ODI) vs StreamSets

Talend Open Studio vs StreamSets

IBM InfoSphere DataStage vs StreamSets

Oracle GoldenGate vs StreamSets

SAP Data Services vs StreamSets

Qlik Replicate vs StreamSets

Alteryx Designer vs StreamSets

Denodo vs StreamSets

Fivetran vs StreamSets

SnapLogic vs StreamSets

Spring Cloud Data Flow vs StreamSets

See all alternatives

Product Categories

Product Categories

Data Integration

Popular Comparisons

Popular Comparisons

Informatica Intelligent Data Management Cloud (IDMC) vs StreamSets

Azure Data Factory vs StreamSets

Informatica PowerCenter vs StreamSets

SSIS vs StreamSets

Oracle Data Integrator (ODI) vs StreamSets

Talend Open Studio vs StreamSets

IBM InfoSphere DataStage vs StreamSets

Oracle GoldenGate vs StreamSets

SAP Data Services vs StreamSets

Qlik Replicate vs StreamSets

Alteryx Designer vs StreamSets

Denodo vs StreamSets

Fivetran vs StreamSets

SnapLogic vs StreamSets

Spring Cloud Data Flow vs StreamSets

See all alternatives

Related questions

20

How does Matillion ETL compare to StreamSets?

38

When evaluating Data Integration, what aspect do you think is the most important to look for?

87

Microsoft SSIS vs. Informatica PowerCenter - which solution has better features?

140

What are the best on-prem ETL tools?

149

Which integration solution is best for a company that wants to integrate systems between sales, marketing, and project development operations systems?

616

Experiences with Oracle GoldenGate vs. Oracle Data Integrator?

19

Should we choose Data Hub or GoldenGate?

8

What are the must-have features for a Data integration system?

57

Is there a bulletproof KPI Data Manager for SME?

7

A recent review wrote that PowerCenter has room for improvement. Agree or Disagree?