Try our new research platform with insights from 80,000+ expert users

Amazon EMR vs Dremio comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 18, 2024
 

Categories and Ranking

Amazon EMR
Ranking in Cloud Data Warehouse
11th
Average Rating
7.8
Reviews Sentiment
7.2
Number of Reviews
22
Ranking in other categories
Hadoop (3rd)
Dremio
Ranking in Cloud Data Warehouse
10th
Average Rating
8.6
Reviews Sentiment
7.2
Number of Reviews
7
Ranking in other categories
Data Science Platforms (8th)
 

Mindshare comparison

As of December 2024, in the Cloud Data Warehouse category, the mindshare of Amazon EMR is 4.4%, down from 4.6% compared to the previous year. The mindshare of Dremio is 4.6%, up from 2.3% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Cloud Data Warehouse
 

Featured Reviews

Prashant  Singh - PeerSpot reviewer
Easy to manage and reliable but the cost is hard to control
The cost is increasing. We are looking into how we can optimize the cost part of EMR. We're doing a comparison between Cloudera running on AWS and running AWS EMR. We don't have much control. If we have multiple users, if they want to scale up, the cost will go and increase and we don't know how we can restrict that price part.
MikeWalker - PeerSpot reviewer
It enables you to manage changes more effectively than any other platform.
Dremio enables you to manage changes more effectively than any other data warehouse platform. There are two things that come into play. One is data lineage. If you are looking at data in Dremio, you may want to know the source and what happened to it along the way or how it may have been transformed in the data pipeline to get to the point where you're consuming it. There's another thing called data providence. They're tied together. Data providence allows you to go back and recreate the data at any particular point in time. It's extremely important for compliance and governance issues because data changes all time. How did it change? What was it three days or months ago? You may have made some decisions based on data that was three months old, so you might need to revisit those. It's essential for things like machine learning and deep learning, where you are generating AI models off data. When the model stops working or doesn't work as expected, you need to figure out why. You have to go back and adjust the datasets used to train the model. We do that through an open-source project called Nessie, which is their basis for providing data lineage and data province capabilities. It's super powerful. Arrow is another open-source project for storing data in memory and performing data query operations. Data sits on a disk in one format. If you want to do anything with data, you have to load it into your computer and put it into memory so you can work with it. Arrow provides a format in memory that enables the whole library to perform various operations on that data. Every vendor has its own way of representing data in memory. They've latched onto an industry standard and developed it so it's open. Now people can use the exact same format in memory to do operations and use the library set to perform functions on data. New developers can decide if they want to develop their own memory format or use one that's already there. Data transfer is a massive problem when you're working with large datasets, doing advanced analytics, and trying to train machine learning or deep learning models. What happens often is companies downsample their data sets to do training on models because transferring and managing data on a deep learning or machine learning platform is too much.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"This is the best tool for hosts and it's really flexible and scalable."
"The project management is very streamlined."
"The initial setup is pretty straightforward."
"The security of the managed workflow and the managed services are the best features for us. Since we inherited their security model and it's all managed services, those are the key benefits for our clients."
"The ability to resize the cluster is what really makes it stand out over other Hadoop and big data solutions."
"When we grade big jobs from on-prem to the cloud, we do it in EMR with Spark."
"It has a variety of options and support systems."
"In Amazon EMR it is easy to rebuild anything, easy to upgrade and has good fault tolerance."
"Dremio gives you the ability to create services which do not require additional resources and sterilization."
"The most valuable feature of Dremio is it can sit on top of any other data storage, such as Amazon S3, Azure Data Factory, SGFS, or Hive. The memory competition is good. If you are running any kind of materialized view, you'd be running in memory."
"Everyone uses Dremio in my company; some use it only for the analytics function."
"Dremio is very easy to use for building queries."
"Dremio enables you to manage changes more effectively than any other data warehouse platform. There are two things that come into play. One is data lineage. If you are looking at data in Dremio, you may want to know the source and what happened to it along the way or how it may have been transformed in the data pipeline to get to the point where you're consuming it."
"We primarily use Dremio to create a data framework and a data queue."
"Dremio allows querying the files I have on my block storage or object storage."
 

Cons

"As people are shifting from legacy solutions to other technologies, Amazon EMR needs to add more features that give more flexibility in managing user data."
"The problem for us is it starts very slow."
"The most complicated thing is configuring to the cluster and ensure it's running correctly."
"Amazon EMR can improve by adding some features, such as megastore services and HiveServer2. Additionally, the user interface could be better, similar to what Apache service provides, cross-platform services."
"There is room for improvement in pricing."
"Amazon EMR is continuously improving, but maybe something like CI/CD out-of-the-box or integration with Prometheus Grafana."
"The product must add some of the latest technologies to provide more flexibility to the users."
"The solution can become expensive if you are not careful."
"They have an automated tool for building SQL queries, so you don't need to know SQL. That interface works, but it could be more efficient in terms of the SQL generated from those things. It's going through some growing pains. There is so much value in tools like these for people with no SQL experience. Over time, Dermio will make these capabilities more accessible to users who aren't database people."
"Dremio takes a long time to execute large queries or the executing of correlated queries or nested queries. Additionally, the solution could improve if we could read data from the streaming pipelines or if it allowed us to create the ETL pipeline directly on top of it, similar to Snowflake."
"Dremio doesn't support the Delta connector. Dremio writes the IT support for Delta, but the support isn't great. There is definitely room for improvement."
"It shows errors sometimes."
"There are performance issues at times due to our limited experience with Dremio, and the fact that we are running it on single nodes using a community version."
"We've faced a challenge with integrating Dremio and Databricks, specifically regarding authentication. It is not shaking hands very easily."
"I cannot use the recursive common table expression (CTE) in Dremio because the support page says it's currently unsupported."
 

Pricing and Cost Advice

"There is no need to pay extra for third-party software."
"The price of the solution is expensive."
"Amazon EMR's price is reasonable."
"The product is not cheap, but it is not expensive."
"There is a small fee for the EMR system, but major cost components are the underlying infrastructure resources which we actually use."
"You don't need to pay for licensing on a yearly or monthly basis, you only pay for what you use, in terms of underlying instances."
"The cost of Amazon EMR is very high."
"Amazon EMR is not very expensive."
"Right now the cluster costs approximately $200,000 per month and is based on the volume of data we have."
"Dremio is less costly competitively to Snowflake or any other tool."
report
Use our free recommendation engine to learn which Cloud Data Warehouse solutions are best for your needs.
824,067 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
25%
Computer Software Company
13%
Manufacturing Company
9%
Educational Organization
7%
Financial Services Firm
32%
Computer Software Company
11%
Manufacturing Company
8%
Retailer
4%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Amazon EMR?
Amazon EMR is a good solution that can be used to manage big data.
What is your experience regarding pricing and costs for Amazon EMR?
The cost of Amazon EMR is a little bit expensive, especially considering the support package, which includes a gold package.
What needs improvement with Amazon EMR?
Spark jobs take longer on Amazon EMR compared to previous experiences. This aspect could be improved to make them more efficient.
What do you like most about Dremio?
Dremio allows querying the files I have on my block storage or object storage.
What is your experience regarding pricing and costs for Dremio?
The licensing is very expensive. We need a license to scale as we are currently using the community version.
What needs improvement with Dremio?
There are performance issues at times due to our limited experience with Dremio, and the fact that we are running it on single nodes using a community version. We face certain issues when connectin...
 

Comparisons

 

Also Known As

Amazon Elastic MapReduce
No data available
 

Learn More

Video not available
 

Overview

 

Sample Customers

Yelp
UBS, TransUnion, Quantium, Daimler, OVH
Find out what your peers are saying about Amazon EMR vs. Dremio and other solutions. Updated: December 2024.
824,067 professionals have used our research since 2012.