Amazon EC2 vs Apache Spark comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
2,488 views|1,632 comparisons
98% willing to recommend
Apache Logo
2,793 views|2,165 comparisons
89% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Amazon EC2 and Apache Spark based on real PeerSpot user reviews.

Find out in this report how the two Compute Service solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Amazon EC2 vs. Apache Spark Report (Updated: May 2024).
772,679 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The serverless architecture solutions are most valuable, and the ability to start with little cost, and then expand as needed.""The most important aspects are that the solution is scalable and easy to manage.""My company uses the tool for cloud monitoring. We have a production, staging, deployment, and testing environment in AWS. However, we do not use the managed service of AWS yet. My team uses the required parameters for security like VPC, firewall, gates of security as well as the external layer of the app.""The product is very mature and organized.""What I found most valuable in Amazon EC2 is that you only pay for what you use, versus an on-premise deployment that requires you to pay for the cost of the server. When it's on-premise, you'll need to meet more specifications and requirements, and the purchasing process even takes time. As Amazon EC2 is cloud-based, you'll only pay when you use the service.""I believe that cloud solutions are better than physical servers.""The tool's performance, reliability, security and flexibility are good. We can use it remotely. The autoscaling functionality of EC2 is quite good. I appreciate the DevOps suite for tracking development tasks. This functionality is important for pure software development.""Stable, scalable, and simple to implement."

More Amazon EC2 Pros →

"The main feature that we find valuable is that it is very fast.""Its scalability and speed are very valuable. You can scale it a lot. It is a great technology for big data. It is definitely better than a lot of earlier warehouse or pipeline solutions, such as Informatica. Spark SQL is very compliant with normal SQL that we have been using over the years. This makes it easy to code in Spark. It is just like using normal SQL. You can use the APIs of Spark or you can directly write SQL code and run it. This is something that I feel is useful in Spark.""I like that it can handle multiple tasks parallelly. I also like the automation feature. JavaScript also helps with the parallel streaming of the library.""The solution is scalable.""One of Apache Spark's most valuable features is that it supports in-memory processing, the execution of jobs compared to traditional tools is very fast.""The good performance. The nice graphical management console. The long list of ML algorithms.""AI libraries are the most valuable. They provide extensibility and usability. Spark has a lot of connectors, which is a very important and useful feature for AI. You need to connect a lot of points for AI, and you have to get data from those systems. Connectors are very wide in Spark. With a Spark cluster, you can get fast results, especially for AI.""Now, when we're tackling sentiment analysis using NLP technologies, we deal with unstructured data—customer chats, feedback on promotions or demos, and even media like images, audio, and video files. For processing such data, we rely on PySpark. Beneath the surface, Spark functions as a compute engine with in-memory processing capabilities, enhancing performance through features like broadcasting and caching. It's become a crucial tool, widely adopted by 90% of companies for a decade or more."

More Apache Spark Pros →

Cons
"One of the challenges is the AMI upgrades.""Amazon EC2's pricing could be better.""Regional acceleration could improve. If I am hosting a website and I want the experience to be faster they should have this feature to allow for increased speeds.""The scalability could improve.""Amazon EC2 is very expensive, and it would be helpful if they decreased the pricing.""The ease of migrating applications could be improved.""I think the whole AWS stack is very disconnected from each other. in the .NET space, everything just works nicely together. In the AWS stack, there is a lot of head scratching.""Technical itself could be a bit more helpful, especially when it comes to integration assistance. When we talk to the technical team, often it's some issue with integration and they'll tell us to talk to the other company. Often, the other company will look at everything and not see an issue from their end and then we are at an impasse."

More Amazon EC2 Cons →

"The graphical user interface (UI) could be a bit more clear. It's very hard to figure out the execution logs and understand how long it takes to send everything. If an execution is lost, it's not so easy to understand why or where it went. I have to manually drill down on the data processes which takes a lot of time. Maybe there could be like a metrics monitor, or maybe the whole log analysis could be improved to make it easier to understand and navigate.""Apart from the restrictions that come with its in-memory implementation. It has been improved significantly up to version 3.0, which is currently in use.""At the initial stage, the product provides no container logs to check the activity.""The management tools could use improvement. Some of the debugging tools need some work as well. They need to be more descriptive.""Include more machine learning algorithms and the ability to handle streaming of data versus micro batch processing.""Its UI can be better. Maintaining the history server is a little cumbersome, and it should be improved. I had issues while looking at the historical tags, which sometimes created problems. You have to separately create a history server and run it. Such things can be made easier. Instead of separately installing the history server, it can be made a part of the whole setup so that whenever you set it up, it becomes available.""The initial setup was not easy.""If you have a Spark session in the background, sometimes it's very hard to kill these sessions because of D allocation."

More Apache Spark Cons →

Pricing and Cost Advice
  • "Pricing appears to be cheap, however, it is extremely difficult in calculating what something will cost."
  • "It has helped to reduce costs with infrastructure."
  • "EC2 pricing is somewhat transparent, in that AWS provides pricing for all instance types. However, the number of pricing options can be confusing."
  • "For our usage, the cost is approximately $20,000 to $23,000 per month."
  • "There is a license required to use this solution and we pay on a monthly basis."
  • "The price is reasonable, but there is definitely an opportunity to lower it in instances which are of a higher configuration, because they have been typically used for the long term."
  • "Amazon EC2 has a pay-as-you-use cost model."
  • "The clients have found the billing of Amazon EC2 good, but the price could be less high. There is a monthly subscription to use the solution."
  • More Amazon EC2 Pricing and Cost Advice →

  • "Since we are using the Apache Spark version, not the data bricks version, it is an Apache license version, the support and resolution of the bug are actually late or delayed. The Apache license is free."
  • "Apache Spark is open-source. You have to pay only when you use any bundled product, such as Cloudera."
  • "We are using the free version of the solution."
  • "Apache Spark is not too cheap. You have to pay for hardware and Cloudera licenses. Of course, there is a solution with open source without Cloudera."
  • "Apache Spark is an expensive solution."
  • "Spark is an open-source solution, so there are no licensing costs."
  • "On the cloud model can be expensive as it requires substantial resources for implementation, covering on-premises hardware, memory, and licensing."
  • "It is an open-source solution, it is free of charge."
  • More Apache Spark Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Compute Service solutions are best for your needs.
    772,679 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The scalability and elasticity are helpful.
    Top Answer:We pay a monthly subscription fee. The price can be improved.
    Top Answer:Accessibility must be improved. It is important to know how fast we can get to the solution. It would be nice if the interface would pop up without much loading. The product must be faster and more… more »
    Top Answer:We use Spark to process data from different data sources.
    Top Answer:In data analysis, you need to take real-time data from different data sources. You need to process this in a subsecond, and do the transformation in a subsecond
    Ranking
    3rd
    out of 16 in Compute Service
    Views
    2,488
    Comparisons
    1,632
    Reviews
    44
    Average Words per Review
    354
    Rating
    8.6
    5th
    out of 16 in Compute Service
    Views
    2,793
    Comparisons
    2,165
    Reviews
    26
    Average Words per Review
    444
    Rating
    8.7
    Comparisons
    AWS Fargate logo
    Compared 63% of the time.
    AWS Lambda logo
    Compared 8% of the time.
    AWS Batch logo
    Compared 8% of the time.
    Apache NiFi logo
    Compared 7% of the time.
    Spring Boot logo
    Compared 31% of the time.
    AWS Batch logo
    Compared 10% of the time.
    Spark SQL logo
    Compared 9% of the time.
    SAP HANA logo
    Compared 8% of the time.
    Jakarta EE logo
    Compared 2% of the time.
    Also Known As
    Amazon Elastic Compute Cloud, EC2
    Learn More
    Overview

    Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides secure, resizable compute capacity in the cloud. It is designed to make web-scale cloud computing easier for developers.

    Amazon EC2’s simple web service interface allows you to obtain and configure capacity with minimal friction. It provides you with complete control of your computing resources and lets you run on Amazon’s proven computing environment. Amazon EC2 reduces the time required to obtain and boot new server instances to minutes, allowing you to quickly scale capacity, both up and down, as your computing requirements change. Amazon EC2 changes the economics of computing by allowing you to pay only for capacity that you actually use. Amazon EC2 provides developers the tools to build failure resilient applications and isolate them from common failure scenarios.

    Spark provides programmers with an application programming interface centered on a data structure called the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. It was developed in response to limitations in the MapReduce cluster computing paradigm, which forces a particular linear dataflowstructure on distributed programs: MapReduce programs read input data from disk, map a function across the data, reduce the results of the map, and store reduction results on disk. Spark's RDDs function as a working set for distributed programs that offers a (deliberately) restricted form of distributed shared memory

    Sample Customers
    Netflix, Expedia, TimeInc., Novaris, airbnb, Lamborghini
    NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
    Top Industries
    REVIEWERS
    Computer Software Company28%
    Financial Services Firm14%
    Comms Service Provider10%
    Government7%
    VISITORS READING REVIEWS
    Financial Services Firm21%
    Computer Software Company17%
    University7%
    Educational Organization6%
    REVIEWERS
    Computer Software Company33%
    Financial Services Firm12%
    University9%
    Marketing Services Firm6%
    VISITORS READING REVIEWS
    Financial Services Firm25%
    Computer Software Company13%
    Manufacturing Company7%
    Comms Service Provider5%
    Company Size
    REVIEWERS
    Small Business43%
    Midsize Enterprise20%
    Large Enterprise37%
    VISITORS READING REVIEWS
    Small Business20%
    Midsize Enterprise12%
    Large Enterprise68%
    REVIEWERS
    Small Business42%
    Midsize Enterprise16%
    Large Enterprise42%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise71%
    Buyer's Guide
    Amazon EC2 vs. Apache Spark
    May 2024
    Find out what your peers are saying about Amazon EC2 vs. Apache Spark and other solutions. Updated: May 2024.
    772,679 professionals have used our research since 2012.

    Amazon EC2 is ranked 3rd in Compute Service with 60 reviews while Apache Spark is ranked 5th in Compute Service with 60 reviews. Amazon EC2 is rated 8.6, while Apache Spark is rated 8.4. The top reviewer of Amazon EC2 writes "Easy to scale and valuable features include the security group and key management". On the other hand, the top reviewer of Apache Spark writes "Reliable, able to expand, and handle large amounts of data well". Amazon EC2 is most compared with AWS Fargate, AWS Lambda, AWS Batch and Apache NiFi, whereas Apache Spark is most compared with Spring Boot, AWS Batch, Spark SQL, SAP HANA and Jakarta EE. See our Amazon EC2 vs. Apache Spark report.

    See our list of best Compute Service vendors.

    We monitor all Compute Service reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.