Try our new research platform with insights from 80,000+ expert users

Apache Hadoop vs Snowflake comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 18, 2024
 

Categories and Ranking

Apache Hadoop
Ranking in Data Warehouse
6th
Average Rating
7.8
Reviews Sentiment
6.8
Number of Reviews
39
Ranking in other categories
No ranking in other categories
Snowflake
Ranking in Data Warehouse
1st
Average Rating
8.4
Reviews Sentiment
7.2
Number of Reviews
98
Ranking in other categories
Cloud Data Warehouse (1st)
 

Mindshare comparison

As of December 2024, in the Data Warehouse category, the mindshare of Apache Hadoop is 5.2%, down from 6.2% compared to the previous year. The mindshare of Snowflake is 17.1%, down from 19.5% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Data Warehouse
 

Q&A Highlights

Miriam Tover - PeerSpot reviewer
Feb 03, 2020
 

Featured Reviews

Sushil Arya - PeerSpot reviewer
Provides ease of integration with the IT workflow of a business
When working with Kafka, I saw that the data came in an incremental order. The incremental data processing part is still not very effective in Apache Hadoop. If the data is already there, it can be processed very effectively, especially if the data is coming in every second. If you want to know the location of some data every second, then such data is not processed effectively in Apache Hadoop. I can say that one of the features where improvements are required revolves around the licensing cost of the tool. If the tool can build some licensing structures in a pay-per-use manner, organizations can get the look and feel of Apache Hadoop. Apache Hadoop can offer a licensing structure of the product that can be seen as similar to how AWS operates. Apache Hadoop can look into the capability of processing incremental data. The tool's setup process can be a scope of improvement. Also, it is not very simple because while doing the setup, we need to do all the server settings, including port listing and firewall configurations. If we look at other products on the market, then they can be made simpler. There are certain shortcomings when it comes to the product's technical support part, making it an area where improvements are required. The time frame for the resolution is an area that needs to be improved. The overall communication part of the technical support team also needs improvement.
VivekSingh 1 - PeerSpot reviewer
Provides good data ingestion capability, but should include more AI capabilities
The solution's integration aspect is good, and all the connectors are in place. I found Snowflake similar to RDS. We use it for both data in motion and data in transit. It looks like the tool handles the data quite securely. We create ETL patterns. We ingest data from different source systems, and we have to create data pipelines. It would be useful if we could have AI features added to identify what I'm going to do with this data. It would be good if it could look at the data and help me create an automated pipeline instead of me creating a pipeline by myself. I'm from a retail background. I completed my Oracle DBA training a long time ago, about 18 years ago. I was quite familiar with the Snowflake and relational database concepts since I had already completed the Oracle ops, DBA ops, OCP, and OPA courses. For me, it was a journey similar to when I shifted from Oracle RDS to Snowflake. Although I was quite familiar with most of the concepts, there were some learnings. Whosoever is in the data field should at least try Snowflake once. They will then realize the best features in the solution and can continue using it. Overall, I rate the solution a seven out of ten.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Initially, with RDBMS alone, we had a lot of work and few servers running on-premise and on cloud for the PoC and incubation. With the use of Hadoop and ecosystem components and tools, and managing it in Amazon EC2, we have created a Big Data "lab" which helps us to centralize all our work and solutions into a single repository. This has cut down the time in terms of maintenance, development and, especially, data processing challenges."
"One valuable feature is that we can download data."
"It's primarily open source. You can handle huge data volumes and create your own views, workflows, and tables. I can also use it for real-time data streaming."
"The performance is pretty good."
"What I like about Apache Hadoop is that it's for big data, in particular big data analysis, and it's the easier solution. I like the data processing feature for AI/ML use cases the most because some solutions allow me to collect data from relational databases, while Hadoop provides me with more options for newer technologies."
"The most valuable features are the ability to process the machine data at a high speed, and to add structure to our data so that we can generate relevant analytics."
"Its flexibility in handling and storing large volumes of data is particularly beneficial, as is its resilience, which ensures data redundancy and fault tolerance."
"I liked that Apache Hadoop was powerful, had a lot of tools, and the fact that it was free and community-developed."
"It's ultra-fast at handling queries, which is what we find very convenient."
"Its performance is a big advantage. When you run a query, its performance is very good. The inbound and outbound share features are also very useful for sharing a particular database. By using these features, you can allow others to access the Snowflake database and query it, which is another advantage of this solution. It has good security, and we can easily integrate it. We can connect it with multiple source systems."
"The solution's computing time is less."
"The solution is very stable."
"The feature that is really striking is the ability to translate the SQL workloads into the NoSQL version that can be used by Snowflake."
"The most valuable feature of Snowflake is it's an all-in-one data warehousing solution."
"The product's most important feature is unloading data to S3."
"The thing I find most valuable is that scalability, space storage, and computing power is separate. When you scale up, it is live from one second to the next — constantly available as you scale — so there is no downtime or interruption of services."
 

Cons

"The load optimization capabilities of the product are an area of concern where improvements are required."
"The solution is very expensive."
"The stability of the solution needs improvement."
"Improvements in security measures would be beneficial, given the large volumes of data handled."
"I think more of the solution needs to be focused around the panel processing and retrieval of data."
"The key shortcoming is its inability to handle queries when there is insufficient memory. This limitation can be bypassed by processing the data in chunks."
"It needs better user interface (UI) functionalities."
"Hadoop lacks OLAP capabilities."
"The aspect of it that was more complicated was stored procedures. It does not support SQL language-based stored procedures. You have to write in JavaScript. If they supported SQL language and stored procedures, it would make migration from on-prem much simpler. In most cases, if an on-prem solution has stored procedures, they're usually written in SQL. They're not written as what most on-prem DBMS would refer to as an external stored procedure, which is what these feel like to most people because they're written in a language outside of SQL."
"Snowflake needs transparency over costs and pricing."
"They need to improve its ETL functionality so that Snowflake becomes an ETL product. Snowpipe can do some pipelines and data ingestion, but as compare to Talend, these functionalities are limited. The ETL feature is not good enough. Therefore, Snowflake can only be used as a database. You can't use it as an ETL tool, which is a limitation. We have spoken to the vendor, and they said they are working on it, but I'm not sure when they will bring it to production."
"Support needs improvement, as it can take several days before you get some initial support."
"There are some stored procedures that we've had trouble with. The solution also needs to fine-tune the connectors to be able to connect into the system source."
"Every product has room for improvement, although in this case, it needs some broadening of the functionality."
"Currently, Snowflake doesn't support unstructured data."
"There are some challenges with loading unstructured data and integrating some message queues or brokers. In one project, we had a problem connecting to one of the message queues and we had to take a different route altogether on Microsoft Azure."
 

Pricing and Cost Advice

"We just use the free version."
"It's reasonable, but there's room for improvement in cost-effectiveness."
"The price could be better. Hortonworks no longer exists, and Cloudera killed the free version of Hadoop."
"The product is open-source, but some associated licensing fees depend on the subscription level."
"This is a low cost and powerful solution."
"If my company can use the cloud version of Apache Hadoop, particularly the cloud storage feature, it would be easier and would cost less because an on-premises deployment has a higher cost during storage, for example, though I don't know exactly how much Apache Hadoop costs."
"​There are no licensing costs involved, hence money is saved on the software infrastructure​."
"Do take into consider that data storage and compute capacity scale differently and hence purchasing a "boxed" / 'all-in-one" solution (software and hardware) might not be the best idea."
"Oracle is less expensive than Snowflake."
"Snowflake is cost-effective. However, the cost can depend on how it's being used and how efficiently the code is written. If engineers don't write efficient code and usage is billed based on processing, it can become costly. If they write optimal code and choose the best solution, it can reduce costs in comparison to other options, such as Oracle."
"The tool's pricing is based on the number of queries you want on your database. The cost is small. To get the tool's pricing, you can do the math based on the cost per query, which is $0.002. If you're running your queries frequently, your charges will be higher than running fewer queries."
"The price of the solution is reasonable."
"We're based on credits. So, we're paying four and a half dollars of credit. There are no additional costs. I would rate it a two out of five in terms of pricing."
"Its price should be improved. It should be cheaper than Microsoft."
"Comparing Snowflake to on-prem options such as Oracle or SAP, it seemed more cost-effective."
"I believe that pricing is reasonable for this solution."
report
Use our free recommendation engine to learn which Data Warehouse solutions are best for your needs.
824,053 professionals have used our research since 2012.
 

Answers from the Community

Miriam Tover - PeerSpot reviewer
Feb 3, 2020
Feb 3, 2020
Interactive querying as a consumption pattern is something Snowflake handles much better than Hadoop and related query engine options - Impala, Presto, Drill etc. Heavy data scientists query workload can be an expensive query pattern on Snowflake and Hadoop can provide a more cost-efficient solution. Hadoop is also still relevant as a back-end data processing engine, instead of leveraging Snowf...
2 out of 3 answers
it_user1108338 - PeerSpot reviewer
Jun 26, 2019
Interactive querying as a consumption pattern is something Snowflake handles much better than Hadoop and related query engine options - Impala, Presto, Drill etc. Heavy data scientists query workload can be an expensive query pattern on Snowflake and Hadoop can provide a more cost-efficient solution. Hadoop is also still relevant as a back-end data processing engine, instead of leveraging Snowflake for data transformation due to higher cost as well as limited procedural language capabilities (javascript based stored procedures). Snowflake fares much better than Hadoop in terms of administrative complexity.
RL
Jun 27, 2019
Hi Nick, I am on vacation this week. Adding Arun on my team but it would probably be valuable to understand the specific context, background and situation that your colleague has to determine the proper advice. I’ll defer to Arun to respond since my bandwidth is limited this week. From: Nick Regan from IT Central Station Reply-To: "replies@itcentralstation.com" Date: Wednesday, June 26, 2019 at 6:15 AM To: "Lescano, Robert" Subject: Seeking expertise in Apache Hadoop Hi Robert, Can you help out a colleague with the following question about Apache Hadoop: ----- What is the biggest difference between Apache Hadoop and Snowflake? One of the most popular comparisons on IT Central Station is Apache Hadoop vs Snowflake. People like you are trying to decide which one is best for their company. Can you help them out? What is the biggest difference between Apache Hadoop and Snowflake? Which of these two solutions would you recommend to a colleague evaluating data warehouse systems and why? Thanks for helping your peers make the best decision! ----- Please reply to this email with your response or post your answer here. You've been a member of IT Central Station since April 2019. In a market full of vendor hype, we provide free connections between real users of Apache Hadoop to share advice and make better buying decisions. Thanks for being part of the community. Nick Regan Community Director, IT Central Station IT Central Station 244 Fifth Avenue New York, NY 10001 (646) 328-1944 um-nqn 354819 To change notifications, please visit your subscription page or unsubscribe completely. gitbdelSFBuZk85SktJK3pxbGt0NEhxQ2RHd0tuVkJBeDZiSktUL2N0KzFZQktFNU8vMW9GZ0Y4ZEpleGZCQmwvQkVwbC0tVzhQSU1tdjdlUjA2VzJMdHBCdlZNQT09--6e1706b96a47f6f1637e3d97f57cf04aad6d5362gitbdel
 

Top Industries

By visitors reading reviews
Financial Services Firm
34%
Computer Software Company
10%
University
7%
Energy/Utilities Company
6%
Educational Organization
36%
Financial Services Firm
12%
Computer Software Company
8%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Apache Hadoop?
It's primarily open source. You can handle huge data volumes and create your own views, workflows, and tables. I can also use it for real-time data streaming.
What is your experience regarding pricing and costs for Apache Hadoop?
The product is open-source, but some associated licensing fees depend on the subscription level. While it might be free for students, organizations typically need to pay for their subscriptions. Th...
What needs improvement with Apache Hadoop?
Hadoop lacks OLAP capabilities. I recommend adding a Delta Lake feature to make the data compatible with ACID properties. Also, video and audio streaming import issues could be improved to ensure p...
What do you like most about Snowflake?
The best thing about Snowflake is its flexibility in changing warehouse sizes or computational power.
What is your experience regarding pricing and costs for Snowflake?
The pricing part is based on the computing and storage. The costs are different and then there are services costs as well. I have heard that Snowflake is costlier than Redshift or GCP BigQuery. A s...
What needs improvement with Snowflake?
I think people do not want to create pipelines for many customers now. Normally, we have this layer architecture, like layer one, layer two, layer three, or layer four, where we have raw data, inte...
 

Comparisons

 

Also Known As

No data available
Snowflake Computing
 

Overview

 

Sample Customers

Amazon, Adobe, eBay, Facebook, Google, Hulu, IBM, LinkedIn, Microsoft, Spotify, AOL, Twitter, University of Maryland, Yahoo!, Cornell University Web Lab
Accordant Media, Adobe, Kixeye Inc., Revana, SOASTA, White Ops
Find out what your peers are saying about Apache Hadoop vs. Snowflake and other solutions. Updated: November 2024.
824,053 professionals have used our research since 2012.