Try our new research platform with insights from 80,000+ expert users

Apache Hadoop vs Snowflake comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

Apache Hadoop
Ranking in Data Warehouse
6th
Average Rating
7.8
Number of Reviews
39
Ranking in other categories
No ranking in other categories
Snowflake
Ranking in Data Warehouse
1st
Average Rating
8.4
Reviews Sentiment
7.5
Number of Reviews
98
Ranking in other categories
Cloud Data Warehouse (1st)
 

Mindshare comparison

As of November 2024, in the Data Warehouse category, the mindshare of Apache Hadoop is 5.1%, down from 6.2% compared to the previous year. The mindshare of Snowflake is 17.5%, down from 19.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Data Warehouse
 

Q&A Highlights

Miriam Tover - PeerSpot reviewer
Feb 03, 2020
 

Featured Reviews

Sushil Arya - PeerSpot reviewer
Provides ease of integration with the IT workflow of a business
When working with Kafka, I saw that the data came in an incremental order. The incremental data processing part is still not very effective in Apache Hadoop. If the data is already there, it can be processed very effectively, especially if the data is coming in every second. If you want to know the location of some data every second, then such data is not processed effectively in Apache Hadoop. I can say that one of the features where improvements are required revolves around the licensing cost of the tool. If the tool can build some licensing structures in a pay-per-use manner, organizations can get the look and feel of Apache Hadoop. Apache Hadoop can offer a licensing structure of the product that can be seen as similar to how AWS operates. Apache Hadoop can look into the capability of processing incremental data. The tool's setup process can be a scope of improvement. Also, it is not very simple because while doing the setup, we need to do all the server settings, including port listing and firewall configurations. If we look at other products on the market, then they can be made simpler. There are certain shortcomings when it comes to the product's technical support part, making it an area where improvements are required. The time frame for the resolution is an area that needs to be improved. The overall communication part of the technical support team also needs improvement.
VivekSingh 1 - PeerSpot reviewer
Provides good data ingestion capability, but should include more AI capabilities
The solution's integration aspect is good, and all the connectors are in place. I found Snowflake similar to RDS. We use it for both data in motion and data in transit. It looks like the tool handles the data quite securely. We create ETL patterns. We ingest data from different source systems, and we have to create data pipelines. It would be useful if we could have AI features added to identify what I'm going to do with this data. It would be good if it could look at the data and help me create an automated pipeline instead of me creating a pipeline by myself. I'm from a retail background. I completed my Oracle DBA training a long time ago, about 18 years ago. I was quite familiar with the Snowflake and relational database concepts since I had already completed the Oracle ops, DBA ops, OCP, and OPA courses. For me, it was a journey similar to when I shifted from Oracle RDS to Snowflake. Although I was quite familiar with most of the concepts, there were some learnings. Whosoever is in the data field should at least try Snowflake once. They will then realize the best features in the solution and can continue using it. Overall, I rate the solution a seven out of ten.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It's good for storing historical data and handling analytics on a huge amount of data."
"The best thing about this solution is that it is very powerful and very cheap."
"I liked that Apache Hadoop was powerful, had a lot of tools, and the fact that it was free and community-developed."
"One valuable feature is that we can download data."
"The platform's quick data processing capabilities have been instrumental in supporting our AI-driven projects."
"Hadoop File System is compatible with almost all the query engines."
"Its integration is Hadoop's best feature because that allows us to support different tools in a big data platform."
"Its flexibility in handling and storing large volumes of data is particularly beneficial, as is its resilience, which ensures data redundancy and fault tolerance."
"Snowflake has three great features: Snowpiping is proving to be very valuable, Time Travel is excellent, and Snowpipes are another great functionality the solution has made available."
"The thing I find most valuable is that scalability, space storage, and computing power is separate. When you scale up, it is live from one second to the next — constantly available as you scale — so there is no downtime or interruption of services."
"It is a very easy-to-use solution. It is user-friendly, and its setup time is very less."
"The tool's performance is good. I think it's the best in the game right now. It usually charges per query. For example, if you run a SQL query on Snowflake with the same number of data records, it would take less than half the time compared to running it on Microsoft. It has good documentation. You can pick up Snowflake if you have previous knowledge of SQL."
"It is a very well-distributed system. It has different data engines for different applications. Many applications can use different computational engines at the same time. In terms of data processing, the feeling was similar to working with a relational database but in a scalable way."
"The syntax is advanced which reduces the time to write code."
"Everything is automatic, and I don't have to do any maintenance."
"We find the data sharing and data marketplace aspects of Snowflake absolutely amazing."
 

Cons

"Hadoop lacks OLAP capabilities."
"Real-time data processing is weak. This solution is very difficult to run and implement."
"The load optimization capabilities of the product are an area of concern where improvements are required."
"Based on our needs, we would like to see a tool for data visualization and enhanced Ambari for management, plus a pre-built IoT hub/model. These would reduce our efforts and the time needed to prove to a customer that this will help them."
"It would be helpful to have more information on how to best apply this solution to smaller organizations, with less data, and grow the data lake."
"The main thing is the lack of community support. If you want to implement a new API or create a new file system, you won't find easy support."
"General installation/dependency issues were there, but were not a major, complex issue. While migrating data from MySQL to Hive, things are a little challenging, but we were able to get through that with support from forums and a little trial and error."
"The solution is very expensive."
"There are a lot of features that they need to come up with. A lot of functions are missing in Snowflake, so we have to find a workaround for those. For example, OUTER APPLY is a basic function in SQL Server, but it is not there in Snowflake. So, you have to write complex code for it."
"They don't have any SLAs in place. It would be better if they did."
"I would like to see more transparency in data processing, ATLs, and compute areas - which should give more comfort to the end users."
"They need to improve its ETL functionality so that Snowflake becomes an ETL product. Snowpipe can do some pipelines and data ingestion, but as compare to Talend, these functionalities are limited. The ETL feature is not good enough. Therefore, Snowflake can only be used as a database. You can't use it as an ETL tool, which is a limitation. We have spoken to the vendor, and they said they are working on it, but I'm not sure when they will bring it to production."
"They do have a native connector to connect with integration tools for loading data, but it would be much better to have the functionality built-in."
"Improvement is needed in integrating external tools, such as data catalogs, which can be complicated due to differing formats and usage across departments."
"There is a scope for improvement. They don't currently support integration with some of the Azure and AWS native services. It would be good if they can enhance their product to integrate with these services."
"There is a need for improvements in the documentation, this would allow more people to switch over to this solution."
 

Pricing and Cost Advice

"The price of Apache Hadoop could be less expensive."
"If my company can use the cloud version of Apache Hadoop, particularly the cloud storage feature, it would be easier and would cost less because an on-premises deployment has a higher cost during storage, for example, though I don't know exactly how much Apache Hadoop costs."
"This is a low cost and powerful solution."
"For any big enterprise the costs can be handled, and it is suitable for big enterprises because the scale of data is large. For medium and small enterprises, the tool is on the high-price side."
"It's reasonable, but there's room for improvement in cost-effectiveness."
"We just use the free version."
"The product is open-source, but some associated licensing fees depend on the subscription level."
"​There are no licensing costs involved, hence money is saved on the software infrastructure​."
"I believe that pricing is reasonable for this solution."
"The price of Snowflake is quite reasonable."
"You pay based on the data that you are storing in the data warehouse and there are no maintenance costs."
"The product's price range falls between average to a bit expensive range. I think the tool is worth the money if you use it properly."
"I am not much aware of the price, but based on what I have analyzed so far, its cost is reasonable as compared to on-prem data warehouse solutions. It provides a great deal for production."
"Snowflake is a cost-effective solution."
"Snowflake has consumption-based costs; users only pay for storage and computing."
"Snowflake’s pricing is transparent. It is one of the cheapest cloud database warehouse providers. The tool follows a credit cost model. Everything on Snowflake is charged on the basis of credits. The credits depend on the cloud region and the public cloud provider that we use. Hence, the cost per credit will be different for AWS in Frankfurt and AWS in India. I think North Virginia is the cheapest region in terms of cost per credit. You will be consuming around 16 credits for large data warehouses."
report
Use our free recommendation engine to learn which Data Warehouse solutions are best for your needs.
816,406 professionals have used our research since 2012.
 

Answers from the Community

Miriam Tover - PeerSpot reviewer
Feb 3, 2020
Feb 3, 2020
Interactive querying as a consumption pattern is something Snowflake handles much better than Hadoop and related query engine options - Impala, Presto, Drill etc. Heavy data scientists query workload can be an expensive query pattern on Snowflake and Hadoop can provide a more cost-efficient solution. Hadoop is also still relevant as a back-end data processing engine, instead of leveraging Snowf...
2 out of 3 answers
it_user1108338 - PeerSpot reviewer
Jun 26, 2019
Interactive querying as a consumption pattern is something Snowflake handles much better than Hadoop and related query engine options - Impala, Presto, Drill etc. Heavy data scientists query workload can be an expensive query pattern on Snowflake and Hadoop can provide a more cost-efficient solution. Hadoop is also still relevant as a back-end data processing engine, instead of leveraging Snowflake for data transformation due to higher cost as well as limited procedural language capabilities (javascript based stored procedures). Snowflake fares much better than Hadoop in terms of administrative complexity.
RL
Jun 27, 2019
Hi Nick, I am on vacation this week. Adding Arun on my team but it would probably be valuable to understand the specific context, background and situation that your colleague has to determine the proper advice. I’ll defer to Arun to respond since my bandwidth is limited this week. From: Nick Regan from IT Central Station Reply-To: "replies@itcentralstation.com" Date: Wednesday, June 26, 2019 at 6:15 AM To: "Lescano, Robert" Subject: Seeking expertise in Apache Hadoop Hi Robert, Can you help out a colleague with the following question about Apache Hadoop: ----- What is the biggest difference between Apache Hadoop and Snowflake? One of the most popular comparisons on IT Central Station is Apache Hadoop vs Snowflake. People like you are trying to decide which one is best for their company. Can you help them out? What is the biggest difference between Apache Hadoop and Snowflake? Which of these two solutions would you recommend to a colleague evaluating data warehouse systems and why? Thanks for helping your peers make the best decision! ----- Please reply to this email with your response or post your answer here. You've been a member of IT Central Station since April 2019. In a market full of vendor hype, we provide free connections between real users of Apache Hadoop to share advice and make better buying decisions. Thanks for being part of the community. Nick Regan Community Director, IT Central Station IT Central Station 244 Fifth Avenue New York, NY 10001 (646) 328-1944 um-nqn 354819 To change notifications, please visit your subscription page or unsubscribe completely. gitbdelSFBuZk85SktJK3pxbGt0NEhxQ2RHd0tuVkJBeDZiSktUL2N0KzFZQktFNU8vMW9GZ0Y4ZEpleGZCQmwvQkVwbC0tVzhQSU1tdjdlUjA2VzJMdHBCdlZNQT09--6e1706b96a47f6f1637e3d97f57cf04aad6d5362gitbdel
 

Top Industries

By visitors reading reviews
Financial Services Firm
32%
Computer Software Company
11%
University
7%
Energy/Utilities Company
6%
Educational Organization
35%
Financial Services Firm
12%
Computer Software Company
9%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Apache Hadoop?
It's primarily open source. You can handle huge data volumes and create your own views, workflows, and tables. I can also use it for real-time data streaming.
What is your experience regarding pricing and costs for Apache Hadoop?
The product is open-source, but some associated licensing fees depend on the subscription level. While it might be free for students, organizations typically need to pay for their subscriptions. Th...
What needs improvement with Apache Hadoop?
Hadoop lacks OLAP capabilities. I recommend adding a Delta Lake feature to make the data compatible with ACID properties. Also, video and audio streaming import issues could be improved to ensure p...
What do you like most about Snowflake?
The best thing about Snowflake is its flexibility in changing warehouse sizes or computational power.
What is your experience regarding pricing and costs for Snowflake?
The pricing part is based on the computing and storage. The costs are different and then there are services costs as well. I have heard that Snowflake is costlier than Redshift or GCP BigQuery. A s...
What needs improvement with Snowflake?
I think people do not want to create pipelines for many customers now. Normally, we have this layer architecture, like layer one, layer two, layer three, or layer four, where we have raw data, inte...
 

Comparisons

 

Also Known As

No data available
Snowflake Computing
 

Overview

 

Sample Customers

Amazon, Adobe, eBay, Facebook, Google, Hulu, IBM, LinkedIn, Microsoft, Spotify, AOL, Twitter, University of Maryland, Yahoo!, Cornell University Web Lab
Accordant Media, Adobe, Kixeye Inc., Revana, SOASTA, White Ops
Find out what your peers are saying about Apache Hadoop vs. Snowflake and other solutions. Updated: November 2024.
816,406 professionals have used our research since 2012.