Try our new research platform with insights from 80,000+ expert users

AWS Fargate vs Apache Spark comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Spark
Ranking in Compute Service
3rd
Average Rating
8.4
Reviews Sentiment
7.7
Number of Reviews
65
Ranking in other categories
Hadoop (1st), Java Frameworks (2nd)
AWS Fargate
Ranking in Compute Service
4th
Average Rating
8.6
Reviews Sentiment
7.5
Number of Reviews
16
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of February 2025, in the Compute Service category, the mindshare of Apache Spark is 11.3%, up from 8.5% compared to the previous year. The mindshare of AWS Fargate is 15.3%, down from 16.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Compute Service
 

Featured Reviews

Ilya Afanasyev - PeerSpot reviewer
Reliable, able to expand, and handle large amounts of data well
We use batch processing. It works well with our formats and file versions. There's a lot of functionality. In our pipeline each hour, we make a copy of data from MongoDB, of the changes from MongoDB to some specific file. Each time pipeline copied all of the data, it would do it each time without changes to all of the tables. Tables have a lot of data, and in the last MongoDB version, there is a possibility to read only changed data. This reduced the cost and configuration of the cluster, and we saved about $150,000. The solution is scalable. It's a stable product.
Subrata Mukherjee - PeerSpot reviewer
Boost demand response with cost-efficient serverless architecture
We are a venture builder company, and if we select AWS for our product. Our design is based on a serverless architecture model. ECS Fargate is the most convenient way in terms of scalability, integration, and cost control Thanks to the serverless model and easy integration features, a few…

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The product's initial setup phase was easy."
"Apache Spark provides a very high-quality implementation of distributed data processing."
"The solution is scalable."
"I found the solution stable. We haven't had any problems with it."
"We use Spark to process data from different data sources."
"The solution is very stable."
"The product’s most valuable features are lazy evaluation and workload distribution."
"AI libraries are the most valuable. They provide extensibility and usability. Spark has a lot of connectors, which is a very important and useful feature for AI. You need to connect a lot of points for AI, and you have to get data from those systems. Connectors are very wide in Spark. With a Spark cluster, you can get fast results, especially for AI."
"Fargate itself is a stable product. We are quite satisfied with its performance."
"It allows for focusing on applications instead of managing infrastructure."
"The most valuable feature of Fargate is that it's self-managed. You don't have to configure your own clusters or deploy any Kubernetes clusters. This simplifies the initial deployment and scaling process."
"AWS Fargate automatically scales to meet demand, making it ideal for applications with variable workloads."
"We appreciate the simple use of containers within this solution, it makes managing the containers quick and easy."
"Fargate's integration with other AWS services is really good."
"AWS Fargate has many valuable services. It does the job with minimal trouble. It's very observable. You can see what's going on and you have logs. You have everything. You can troubleshoot it. It's affordable and it's flexible."
"By using a server's compute resources, one can observe the resource metrics. With AWS, one can determine when servers will be used based on CloudWatch results. For example, CloudWatch informs the application and service platform when the hit ratio has reached the threshold value."
 

Cons

"It should support more programming languages."
"One limitation is that not all machine learning libraries and models support it."
"Stream processing needs to be developed more in Spark. I have used Flink previously. Flink is better than Spark at stream processing."
"For improvement, I think the tool could make things easier for people who aren't very technical. There's a significant learning curve, and I've seen organizations give up because of it. Making it quicker or easier for non-technical people would be beneficial."
"When you are working with large, complex tasks, the garbage collection process is slow and affects performance."
"We use big data manager but we cannot use it as conditional data so whenever we're trying to fetch the data, it takes a bit of time."
"The Spark solution could improve in scheduling tasks and managing dependencies."
"The graphical user interface (UI) could be a bit more clear. It's very hard to figure out the execution logs and understand how long it takes to send everything. If an execution is lost, it's not so easy to understand why or where it went. I have to manually drill down on the data processes which takes a lot of time. Maybe there could be like a metrics monitor, or maybe the whole log analysis could be improved to make it easier to understand and navigate."
"The main area for improvement is the cost, which could be lowered to be more competitive with other major cloud providers."
"Service computing is not as straightforward compared to other computing services. It requires more effort to use effectively."
"AWS Fargate could improve the privileged mode containers. We had some problems and they were not able to run."
"As I have not worked with Fargate extensively, I do not have any specific improvements."
"If there are any options to manage containers, that would be good. That relates more to the cost point. For example, over the next three months, I'll be making a comparison between solutions like CAST AI and other software-as-a-service platforms that offer Kubernetes management with an emphasis on cost reduction."
"We would like to see some improvement in the process documents that are provided with this product, particularly for auto-scaling and other configuration tools that are a bit complicated."
"I heard from my team that it's not easy to predict the cost. That is the only issue we have with AWS Fargate, but I think that's acceptable. AWS Fargate isn't user-friendly. Anything related to Software as a Service or microservice architecture is not easy to implement. You're required to have DevOps from your side to implement the solution. AWS Fargate is just a temporary solution for us. When we grow to a certain level, we may use AKS for better control."
"There is a tool named Compose that helps in converting the Docker Compose file into a Kubernetes file. For ECS and Fargate, AWS reads a Dockerfile and helps with conversion. However, I am uncertain if it's ready for deployment after conversion."
 

Pricing and Cost Advice

"The tool is an open-source product. If you're using the open-source Apache Spark, no fees are involved at any time. Charges only come into play when using it with other services like Databricks."
"Licensing costs can vary. For instance, when purchasing a virtual machine, you're asked if you want to take advantage of the hybrid benefit or if you prefer the license costs to be included upfront by the cloud service provider, such as Azure. If you choose the hybrid benefit, it indicates you already possess a license for the operating system and wish to avoid additional charges for that specific VM in Azure. This approach allows for a reduction in licensing costs, charging only for the service and associated resources."
"I did not pay anything when using the tool on cloud services, but I had to pay on the compute side. The tool is not expensive compared with the benefits it offers. I rate the price as an eight out of ten."
"It is quite expensive. In fact, it accounts for almost 50% of the cost of our entire project."
"We are using the free version of the solution."
"Apache Spark is an expensive solution."
"It is an open-source platform. We do not pay for its subscription."
"Considering the product version used in my company, I feel that the tool is not costly since the product is available for free."
"We would advise that this solution has a slightly-higher price point than others on the market. There is a free plan available for start-ups, but the free and lower range licensing models do not provide the full functionality."
"I rate the price of AWS Fargate a four out of five."
report
Use our free recommendation engine to learn which Compute Service solutions are best for your needs.
838,713 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
27%
Computer Software Company
13%
Manufacturing Company
7%
Comms Service Provider
5%
Financial Services Firm
23%
Computer Software Company
14%
Government
7%
Comms Service Provider
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Apache Spark?
We use Spark to process data from different data sources.
What is your experience regarding pricing and costs for Apache Spark?
Compared to other solutions like Doc DB, Spark is more costly due to the need for extensive infrastructure. It requires significant investment in infrastructure, which can be expensive. While cloud...
What needs improvement with Apache Spark?
The Spark solution could improve in scheduling tasks and managing dependencies. Spark alone cannot handle sequential tasks, requiring environments like Airflow scheduler or scripts. For instance, o...
What do you like most about AWS Fargate?
The most valuable feature of Fargate is that it's self-managed. You don't have to configure your own clusters or deploy any Kubernetes clusters. This simplifies the initial deployment and scaling p...
What needs improvement with AWS Fargate?
There is a tool named Compose that helps in converting the Docker Compose file into a Kubernetes file. For ECS and Fargate, AWS reads a Dockerfile and helps with conversion. However, I am uncertain...
What advice do you have for others considering AWS Fargate?
I rate Fargate ten out of ten. The most significant advantage is the unified configuration for all containers deployed by ECS, allowing seamless integration with services like OpenAI or Google Gemi...
 

Comparisons

 

Overview

 

Sample Customers

NASA JPL, UC Berkeley AMPLab, Amazon, eBay, Yahoo!, UC Santa Cruz, TripAdvisor, Taboola, Agile Lab, Art.com, Baidu, Alibaba Taobao, EURECOM, Hitachi Solutions
Expedia, Intuit, Royal Dutch Shell, Brooks Brothers
Find out what your peers are saying about AWS Fargate vs. Apache Spark and other solutions. Updated: January 2025.
838,713 professionals have used our research since 2012.