Try our new research platform with insights from 80,000+ expert users

Dataiku vs Dremio comparison

Sponsored
 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 5, 2024
 

Categories and Ranking

IBM SPSS Statistics
Sponsored
Ranking in Data Science Platforms
9th
Average Rating
8.0
Reviews Sentiment
6.9
Number of Reviews
37
Ranking in other categories
Data Mining (3rd)
Dataiku
Ranking in Data Science Platforms
7th
Average Rating
8.0
Reviews Sentiment
7.2
Number of Reviews
8
Ranking in other categories
No ranking in other categories
Dremio
Ranking in Data Science Platforms
8th
Average Rating
8.6
Reviews Sentiment
7.2
Number of Reviews
7
Ranking in other categories
Cloud Data Warehouse (10th)
 

Mindshare comparison

As of December 2024, in the Data Science Platforms category, the mindshare of IBM SPSS Statistics is 2.7%, up from 2.7% compared to the previous year. The mindshare of Dataiku is 11.8%, up from 7.6% compared to the previous year. The mindshare of Dremio is 4.2%, up from 2.3% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Data Science Platforms
 

Featured Reviews

Md Masudul Hassan - PeerSpot reviewer
Comprehensive data analysis capabilities with a user-friendly interface, providing an efficient and reliable platform for researchers and analysts
I believe that offering short-term SPSS licenses, perhaps when customer sourcing is available, could make it more affordable. These licenses shouldn't include features tailored for universities or large sales organizations. Instead, they could offer discounts or additional facilities for smaller entities to access the software. In developing countries, it would be beneficial to provide certain features to users at no cost initially, while also customizing pricing options. For example, offering basic features to the first hundred users can help them become familiar with the software and its capabilities. This approach encourages users to upgrade to higher tiers as they become more experienced and require additional functionality.
Sabrine Bendimerad - PeerSpot reviewer
Saves a lot of time because I can quickly handle all the data preparation tasks and concentrate on building my machine learning algorithms
One of the main challenges was collaboration. Developers typically use GitHub to push and manage code, but integrating GitHub with Dataiku was complicated. While it was theoretically possible to use GitHub with Dataiku, in practice, it was difficult to manage our code effectively and push it from Dataiku to GitHub. Another limitation was its ability to handle different types of data. While Dataiku is powerful for working with structured data, like regular or geospatial data, it struggled with more complex data types such as text and image. In addition to the challenges with GitHub integration, the limited support for diverse data types was another feature lacking at that time.
MikeWalker - PeerSpot reviewer
It enables you to manage changes more effectively than any other platform.
Dremio enables you to manage changes more effectively than any other data warehouse platform. There are two things that come into play. One is data lineage. If you are looking at data in Dremio, you may want to know the source and what happened to it along the way or how it may have been transformed in the data pipeline to get to the point where you're consuming it. There's another thing called data providence. They're tied together. Data providence allows you to go back and recreate the data at any particular point in time. It's extremely important for compliance and governance issues because data changes all time. How did it change? What was it three days or months ago? You may have made some decisions based on data that was three months old, so you might need to revisit those. It's essential for things like machine learning and deep learning, where you are generating AI models off data. When the model stops working or doesn't work as expected, you need to figure out why. You have to go back and adjust the datasets used to train the model. We do that through an open-source project called Nessie, which is their basis for providing data lineage and data province capabilities. It's super powerful. Arrow is another open-source project for storing data in memory and performing data query operations. Data sits on a disk in one format. If you want to do anything with data, you have to load it into your computer and put it into memory so you can work with it. Arrow provides a format in memory that enables the whole library to perform various operations on that data. Every vendor has its own way of representing data in memory. They've latched onto an industry standard and developed it so it's open. Now people can use the exact same format in memory to do operations and use the library set to perform functions on data. New developers can decide if they want to develop their own memory format or use one that's already there. Data transfer is a massive problem when you're working with large datasets, doing advanced analytics, and trying to train machine learning or deep learning models. What happens often is companies downsample their data sets to do training on models because transferring and managing data on a deep learning or machine learning platform is too much.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It is perfectly adequate if all you need are the results and not the trail of evidence."
"in terms of the simplicity, I think the SPSS basic can handle it."
"The most valuable features are the solution is easy to use, training new users is not difficult, and our usage is comprehensive because the whole service is beneficial."
"SPSS can handle whatever you throw at it, whether your data set contains 10,000, 100,000, or a million objects. It's like the heavy artillery of analytical tools."
"One feature I found very valuable was the analysis of variance (ANOVA)."
"Most of the product features are good but I particularly like the linear regression analysis."
"It is a modeling tool with helpful automation."
"Capability analysis is one of the main and valuable functions. We also do some hypothesis testing in Minitab and summary stats. These are the functions that we find very useful."
"The most valuable feature of this solution is that it is one tool that can do everything, and you have the ability to very easily push your design to prediction."
"The most valuable feature is the set of visual data preparation tools."
"Data Science Studio's data science model is very useful."
"The advantage is that you can focus on machine learning while having access to what they call 'recipes.' These recipes allow me to preprocess and prepare data without writing any code."
"If many teams are collaborating and sharing Jupyter notebooks, it's very useful."
"I like the interface, which is probably my favorite part of the solution. It is really user-friendly for an IT person."
"Extremely easy to use with its GUI-based functionality and large compatibility with various data sources. Also, maintenance processes are much more automated than ever, with fewer errors."
"Cloud-based process run helps in not keeping the systems on while processes are running."
"Dremio enables you to manage changes more effectively than any other data warehouse platform. There are two things that come into play. One is data lineage. If you are looking at data in Dremio, you may want to know the source and what happened to it along the way or how it may have been transformed in the data pipeline to get to the point where you're consuming it."
"The most valuable feature of Dremio is it can sit on top of any other data storage, such as Amazon S3, Azure Data Factory, SGFS, or Hive. The memory competition is good. If you are running any kind of materialized view, you'd be running in memory."
"Everyone uses Dremio in my company; some use it only for the analytics function."
"Dremio allows querying the files I have on my block storage or object storage."
"We primarily use Dremio to create a data framework and a data queue."
"Dremio is very easy to use for building queries."
"Dremio gives you the ability to create services which do not require additional resources and sterilization."
 

Cons

"There is a learning curve; it's not very steep, but there is one."
"Most of the package will give you the fixed value, or the p-value, without an explanation as to whether it it significant or not. Some beginners might need not just the results, but also some explanation for them."
"I would like SPSS to improve its integration with other data-filing IBM tools. I also think its duration with data, utilization, and graphics could be better."
"Better documentation on how to use macros."
"Technical support needs some improvement, as they do not respond as quickly as we would like."
"If there is any self-generation data collection plan (DCP), it would be helpful in gathering data. It would also be useful if there is a function to scale it up to, let's say, UiPath and have it consolidate and integrate into a UiPath solution."
"Needs more statistical modelling functions."
"The solution could improve by providing a visual network for predictions and a self-organizing map for clustering."
"Dataiku still needs some coding, and that could be a difference where business data scientists would go for DataRobot more than Dataiku."
"In the next release of this solution, I would like to see deep learning better integrated into the tool and not simply an extension or plugin."
"Server up-time needs to be improved. Also, query engines like Spark and Hive need to be more stable."
"Although known for Big Data, the processing time to process 1.8 billion records was terribly slow (five days)."
"I think it would help if Data Science Studio added some more features and improved the data model."
"The ability to have charts right from the explorer would be an improvement."
"I find that it is a little slow during use. It takes more time than I would expect for operations to complete."
"One of the main challenges was collaboration. Developers typically use GitHub to push and manage code, but integrating GitHub with Dataiku was complicated."
"Dremio doesn't support the Delta connector. Dremio writes the IT support for Delta, but the support isn't great. There is definitely room for improvement."
"There are performance issues at times due to our limited experience with Dremio, and the fact that we are running it on single nodes using a community version."
"It shows errors sometimes."
"I cannot use the recursive common table expression (CTE) in Dremio because the support page says it's currently unsupported."
"Dremio takes a long time to execute large queries or the executing of correlated queries or nested queries. Additionally, the solution could improve if we could read data from the streaming pipelines or if it allowed us to create the ETL pipeline directly on top of it, similar to Snowflake."
"They have an automated tool for building SQL queries, so you don't need to know SQL. That interface works, but it could be more efficient in terms of the SQL generated from those things. It's going through some growing pains. There is so much value in tools like these for people with no SQL experience. Over time, Dermio will make these capabilities more accessible to users who aren't database people."
"We've faced a challenge with integrating Dremio and Databricks, specifically regarding authentication. It is not shaking hands very easily."
 

Pricing and Cost Advice

"More affordable training for new staff members."
"SPSS is an expensive piece of software because it's incredibly complex and has been refined over decades, but I would say it's fairly priced."
"The price of IBM SPSS Statistics could improve."
"The price of this solution is a little bit high, which was a problem for my company."
"While the pricing of the product may be higher, the accompanying service and features justify the investment."
"I rate the tool's pricing a five out of ten."
"We think that IBM SPSS is expensive for this function."
"It's quite expensive, but they do a special deal for universities."
"Pricing is pretty steep. Dataiku is also not that cheap."
"The annual licensing fees are approximately €20 ($22 USD) per key for the basic version and €40 ($44 USD) per key for the version with everything."
"Dremio is less costly competitively to Snowflake or any other tool."
"Right now the cluster costs approximately $200,000 per month and is based on the volume of data we have."
report
Use our free recommendation engine to learn which Data Science Platforms solutions are best for your needs.
824,053 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
17%
Computer Software Company
9%
University
8%
Manufacturing Company
8%
Financial Services Firm
18%
Educational Organization
16%
Manufacturing Company
9%
Computer Software Company
8%
Financial Services Firm
32%
Computer Software Company
11%
Manufacturing Company
8%
Retailer
4%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about IBM SPSS Statistics?
The software offers consistency across multiple research projects helping us with predictive analytics capabilities.
What is your experience regarding pricing and costs for IBM SPSS Statistics?
The cost of IBM SPSS Statistics is managed by organizations, not individual researchers. It is a very expensive produ...
What needs improvement with IBM SPSS Statistics?
IBM SPSS Statistics does not keep you close to your data like KNIME. In KNIME, at every stage, you can see the result...
What needs improvement with Dataiku Data Science Studio?
One of the main challenges was collaboration. Developers typically use GitHub to push and manage code, but integratin...
What is your primary use case for Dataiku Data Science Studio?
We use the solution for data science and machine learning.
What do you like most about Dremio?
Dremio allows querying the files I have on my block storage or object storage.
What is your experience regarding pricing and costs for Dremio?
The licensing is very expensive. We need a license to scale as we are currently using the community version.
What needs improvement with Dremio?
There are performance issues at times due to our limited experience with Dremio, and the fact that we are running it ...
 

Comparisons

 

Also Known As

SPSS Statistics
Dataiku DSS
No data available
 

Learn More

Video not available
Video not available
 

Overview

 

Sample Customers

LDB Group, RightShip, Tennessee Highway Patrol, Capgemini Consulting, TEAC Corporation, Ironside, nViso SA, Razorsight, Si.mobil, University Hospitals of Leicester, CROOZ Inc., GFS Fundraising Solutions, Nedbank Ltd., IDS-TILDA
BGL BNP Paribas, Dentsu Aegis, Link Mobility Group, AramisAuto
UBS, TransUnion, Quantium, Daimler, OVH
Find out what your peers are saying about Dataiku vs. Dremio and other solutions. Updated: December 2024.
824,053 professionals have used our research since 2012.