Palantir Foundry vs StreamSets comparison

Read 24 StreamSets reviews

4,119 Views
2,282 Comparison Views

100% willing to recommend

Palantir Foundry

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Palantir Foundry and StreamSets based on real PeerSpot user reviews.

Find out in this report how the two Data Integration solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.

To learn more, read our detailed Palantir Foundry vs. StreamSets Report (Updated: May 2024).

Palantir Foundry vs. StreamSets

Download the complete report

Helped 787,061 peers since 2012

Categories and Ranking

Palantir Foundry

Ranking in Data Integration

11th

Average Rating

7.6

Number of Reviews

Ranking in other categories

IT Operations Analytics (5th), Supply Chain Analytics (1st), Cloud Data Integration (12th), Data Migration Appliances (3rd), Data Management Platforms (DMP) (1st), Data and Analytics Service Providers (1st)

StreamSets

Ranking in Data Integration

8th

Average Rating

8.4

Number of Reviews

Ranking in other categories

No ranking in other categories

Market share comparison

As of June 2024, in the Data Integration category, the market share of Palantir Foundry is 1.6% and it decreased by 53.7% compared to the previous year. The market share of StreamSets is 1.6% and it increased by 29.9% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Data Integration

Unique Categories:

IT Operations Analytics

2.7%

Supply Chain Analytics

50.0%

No other categories found

Featured Reviews

Marco Cheung

Certified developer on Palantir Foundry

Dec 12, 2022

Provides great data integration and takes out the complexity of building your own tech stack

Palantir Foundry builds full applications for us. We can build an end-to-end application from data ingestion and data pipelining, to application building. Early on, we built an internal application that ingested data from our ERP and BI environment that is used by around 700 users. Palantir…

Read full review

Namanya Brian

CEO-founder at Tubayo

Apr 14, 2023

Data streams and pipelines help our team identify areas for improvement in our solution

One of the things I like is the data pipelines. They have a very good design. Implementing pipelines is very straightforward. It doesn't require any technical skill. We have also integrated it with Kafka messaging and it is not complex to do. It is really so easy to connect or integrate with data interfaces. And moving data into analytics platforms using StreamSets is easy. It doesn't require any coding, meaning your can transfer or move data into data payloads without coding skills. It's a good move, for someone in the beginning, who doesn't have any knowledge because it's quite easy.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"The interface is really user-friendly."

"The virtualization tool is useful."

"Encapsulates all the components without the requirement to integrate or check compatibility."

"The data lineage is great."

"It's scalable."

"The AI engine that comes with Palantir Foundry is quite interesting."

"The solution offers very good end-to-end capabilities."

"The ease of use is my favorite feature. We're able to build different models and projects or combine different projects to build one use case."

More Palantir Foundry pros

"The best feature that I really like is the integration."

"Also, the intuitive canvas for designing all the streams in the pipeline, along with the simplicity of the entire product are very big pluses for me. The software is very simple and straightforward. That is something that is needed right now."

"StreamSets’ data drift resilience has reduced the time it takes us to fix data drift breakages. For example, in our previous Hadoop scenario, when we were creating the Sqoop-based processes to move data from source to destinations, we were getting the job done. That took approximately an hour to an hour and a half when we did it with Hadoop. However, with the StreamSets, since it works on a data collector-based mechanism, it completes the same process in 15 minutes of time. Therefore, it has saved us around 45 minutes per data pipeline or table that we migrate. Thus, it reduced the data transfer, including the drift part, by 45 minutes."

"It is a very powerful, modern data analytics solution, in which you can integrate a large volume of data from different sources. It integrates all of the data and you can design, create, and monitor pipelines according to your requirements. It is an all-in-one day data ops solution."

"The most valuable feature is the pipelines because they enable us to pull in and push out data from different sources and to manipulate and clean things up within them."

"StreamSets data drift feature gives us an alert upfront so we know that the data can be ingested. Whatever the schema or data type changes, it lands automatically into the data lake without any intervention from us, but then that information is crucial to fix for downstream pipelines, which process the data into models, like Tableau and Power BI models. This is actually very useful for us. We are already seeing benefits. Our pipelines used to break when there were data drift changes, then we needed to spend about a week fixing it. Right now, we are saving one to two weeks. Though, it depends on the complexity of the pipeline, we are definitely seeing a lot of time being saved."

"The most valuable would be the GUI platform that I saw. I first saw it at a special session that StreamSets provided towards the end of the summer. I saw the way you set it up and how you have different processes going on with your data. The design experience seemed to be pretty straightforward to me in terms of how you drag and drop these nodes and connect them with arrows."

"In StreamSets, everything is in one place."

More StreamSets pros

Cons

"The data lineage was challenging. It's hard to track data from the sources as it moves through stages. Informatica EDC can easily capture and report it because it talks to the metadata. This is generated across those various staging points."

"The solution could use more online documentation for new users."

"The workflow could be improved."

"The solution's visualization and analysis could be improved."

"They do not have a data center in Europe, and we have lots of personally identifiable information in our dataset that needs to be hosted by a third-party data center like Amazon or Microsoft Azure."

"The frontend capabilities of Palantir Foundry could be improved."

"Compared to other hyperscalers, Palantir Foundry is complex and not so user-intuitive."

"Cost of this solution is quite high."

More Palantir Foundry cons

"The execution engine could be improved. When I was at their session, they were using some obscure platform to run. There is a controller, which controls what happens on that, but you should be able to easily do this at any of the cloud services, such as Google Cloud. You shouldn't have any issues in terms of how to run it with their online development platform or design platform, basically their execution engine. There are issues with that."

"The software is very good overall. Areas for improvement are the error logging and the version history. I would like to see better, more detailed error logging information."

"We often faced problems, especially with SAP ERP. We struggled because many columns weren't integers or primary keys, which StreamSets couldn't handle. We had to restructure our data tables, which was painful. Also, pipeline failures were common, and data drifting wasn't addressed, which made things worse. Licensing was another issue we encountered."

"I would like to see further improvement in the UI. In addition, upgrades are not automatic and they should be automated. Currently, we have to manually upgrade versions."

"One area for improvement could be the cloud storage server speed, as we have faced some latency issues here and there."

"There aren't enough hands-on labs, and debugging is also an issue because it takes a lot of time. Logs are not that clear when you are debugging, and you can only select a single source for a pipeline."

"The logging mechanism could be improved. If I am working on a pipeline, then create a job out of it and it is running, it will generate constant logs. So, the logging mechanism could be simplified. Now, it is a bit difficult to understand and filter the logs. It takes some time."

"Currently, we can only use the query to read data from SAP HANA. What we would like to see, as soon as possible, is the ability to read from multiple tables from SAP HANA. That would be a really good thing that we could use immediately. For example, if you have 100 tables in SQL Server or Oracle, then you could just point it to the schema or the 100 tables and ingestion information. However, you can't do that in SAP HANA since StreamSets currently is lacking in this. They do not have a multi-table feature for SAP HANA. Therefore, a multi-table origin for SAP HANA would be helpful."

More StreamSets cons

Pricing and Cost Advice

"The solution’s pricing is high."

"Palantir Foundry has different pricing models that can be negotiated."

"It's expensive."

"It's not expensive because you pay per month, and the tasks you can perform with it are huge. It's reliable and cost-effective."

"The licensing is expensive, and there are other costs involved too. I know from using the software that you have to buy new features whenever there are new updates, which I don't really like. But initially, it was very good."

"StreamSets Data Collector is open source. One can utilize the StreamSets Data Collector, but the Control Hub is the main repository where all the jobs are present. Everything happens in Control Hub."

"The pricing is too fixed. It should be based on how much data you need to process. Some businesses are not so big that they process a lot of data."

"The overall cost is very flexible so it is not a burden for our organization... However, the cost should be improved. For small and mid-size organizations it might be a challenge."

"We are running the community version right now, which can be used free of charge."

"It has a CPU core-based licensing, which works for us and is quite good."

"We use the free version. It's great for a public, free release. Our stance is that the paid support model is too expensive to get into. They should honestly reevaluate that."

More StreamSets pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Data Integration solutions are best for your needs.

See recommendations

787,061 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Manufacturing Company

12%

Financial Services Firm

11%

Computer Software Company

11%

Government

Financial Services Firm

17%

Computer Software Company

13%

Manufacturing Company

Government

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

Questions from the Community

What do you like most about Palantir Foundry?

Palantir Foundry is a robust platform that has really strong plugin connectors and provides features for real-time integration.

What needs improvement with Palantir Foundry?

The solution's pricing is high. Compared to other hyperscalers, Palantir Foundry is complex and not so user-intuitive. There could possibly be a little bit of overhead concerning the maintainabilit...

What is your primary use case for Palantir Foundry?

Palantir Foundry is being used for multiple hybrid cloud integrations in one of the services we provide for an existing US-based customer. It's all about getting together data from Azure and Amazon...

What do you like most about StreamSets?

The best thing about StreamSets is its plugins, which are very useful and work well with almost every data source. It's also easy to use, especially if you're comfortable with SQL. You can customiz...

What needs improvement with StreamSets?

We often faced problems, especially with SAP ERP. We struggled because many columns weren't integers or primary keys, which StreamSets couldn't handle. We had to restructure our data tables, which ...

What is your primary use case for StreamSets?

StreamSets is used for data transformation rather than ETL processes. It focuses on transforming data directly from sources without handling the extraction part of the process. The transformed data...

Azure Data Factory vs Palantir Foundry

Comparisons

Compared 16% of the time

Palantir Gotham vs Palantir Foundry

Compared 8% of the time

SAP Data Services vs Palantir Foundry

Compared 6% of the time

AWS Glue vs Palantir Foundry

Compared 6% of the time

Mule Anypoint Platform vs Palantir Foundry

Compared 4% of the time

More Palantir Foundry Competitors

Fivetran vs StreamSets

Compared 12% of the time

Informatica PowerCenter vs StreamSets

Compared 12% of the time

Azure Data Factory vs StreamSets

Compared 11% of the time

SSIS vs StreamSets

Compared 7% of the time

IBM InfoSphere DataStage vs StreamSets

Compared 6% of the time

More StreamSets Competitors

Product Reports

Palantir Foundry

Download Palantir Foundry product report

Download StreamSets product report

Learn More

Palantir

Video not available

Overview

Palantir Foundry is an enterprise data management platform offering comprehensive tooling for working with big data. Because it is an operating system made for modern enterprises, it is highly available and a continuously updated platform.

Palantir Foundry is a fully managed SaaS platform that spans from cloud hosting and data integration to flexible analytics, visualization, model-building, operational decision-making, and decision capture. It equips technical and non-technical users to make data-driven operational decisions.

Palantir Foundry includes tools to integrate data of any scale, format, or structure, and also has granular, flexible access controls for individual datasets. In addition, it has an open, modular architecture with multiple RESTful APIs, it has native applications for developing machine learning and artificial intelligence, it provides sophisticated data science applications for users of all technical abilities, and much more.

Palantir Foundry Features

The most valuable Palantir Foundry features include:

Security, flexibility, interoperability, easy deployment, built-in role classification, purpose-based access controls, interoperable architecture, model integration, AI modeling tools, ontology, custom workflows, team-specific applications, self-serve analytics, lineage system, operational application building, 200+ data connectors, data versioning, change management framework, sand decision orchestration, and custom dashboard and report building tools.

With Palantir Foundry You Can:

Accelerate development & operations
Collaborate globally
Save time on security
Reduce costs

Palantir Foundry Benefits

Some of the many Palantir Foundry benefits include:

Modular: Because Palantir Foundry is modular, it can integrate with existing infrastructure.
Granular governance: Robust data governance controls help ensure seamless compliance, auditability, and security.
Secure data sharing: The security infrastructure allows you to share data securely, within organizations and with chosen partners.
Rapid integration: Palantir Foundry can rapidly integrate models and data from data platforms into an operational ontology, and can also fuel existing data platforms.
Stand-alone deployment: Palantir Foundry can be deployed standalone and can provide all necessary capabilities for data connection, data integration, and model building.
Prevent lock-in: The data and model integration suites are designed to prevent lock-in, and assume that tools will be interoperating with Palantir Foundry as an organization grows.
No SQL necessary: Users do not have to use SQL queries or employ engineers to write strings in order to search petabytes of data. With Palantir Foundry, natural language is used to query data and results are returned in real-time.
Excellent data integration: Palantir Foundry provides secure, scalable, and resilient integration of all data sources.
Availability: The Palantir platform uses DNS routing, gateways and elastic load balancing to ensure availability. Dedicated accounts and virtual resources are used on a per customer basis.
Multiple metrics types: The Palantir platform provides hundreds of metrics. Some include average session length, drop-off rate, number of logins per user, number of accounts, and search speed.

Reviews from Real Users

PeerSpot users like Palantir Foundry because it has many advantages:

“It is user-friendly, good automation, and allows you to do a better job of data governance.” - Associate, Inhouse Consulting at a pharma/biotech company

“Works seamlessly with good end-to-end capabilities and the capability to scale.” - Wallace H., Sr. Director at a tech services company

StreamSets is a data integration platform that enables organizations to efficiently move and process data across various systems. It offers a user-friendly interface for designing, deploying, and managing data pipelines, allowing users to easily connect to various data sources and destinations. StreamSets also provides real-time monitoring and alerting capabilities, ensuring that data is flowing smoothly and any issues are quickly addressed.

Sample Customers

Merck KGaA, Airbus, Ferrari,United States Intelligence Community, United States Department of Defense

Availity, BT Group, Humana, Deluxe, GSK, RingCentral, IBM, Shell, SamTrans, State of Ohio, TalentFulfilled, TechBridge

Palantir Foundry vs. StreamSets