Spark SQL pros and cons

Vendor: Apache

3.9 out of 5

14 reviews
85% willing to recommend

173 followers

Post review

Spark SQL Pros review quotes

Lucas Dreyer

Data Engineer at BBD

Jan 4, 2023

Certain data sets that are very large are very difficult to process with Pandas and Python libraries. Spark SQL has helped us a lot with that.

Read full review

SurjitChoudhury

Data engineer at Cocos pt

Nov 23, 2023

Spark SQL's efficiency in managing distributed data and its simplicity in expressing complex operations make it an essential part of our data pipeline.

Read full review

Keshav Mandal

Senior Analyst/ Customer Business and Insights Specialist at a tech services company with 501-1,000 employees

Nov 22, 2022

The solution is easy to understand if you have basic knowledge of SQL commands.

Free Report: Spark SQL Reviews and More

Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.

DOWNLOAD NOW

824,067 professionals have used our research since 2012.

Slaven Batnozic

CTO at Dokument IT d.o.o.

Aug 18, 2023

I find the Thrift connection valuable.

Read full review

Aria Amini

Data Engineer at Behsazan Mellat

Jul 26, 2023

One of Spark SQL's most beautiful features is running parallel queries to go through enormous data.

Read full review

Srinivasan Sugumar

Analytics and Reporting Manager at a financial services firm with 1,001-5,000 employees

Mar 18, 2020

The speed of getting data.

Read full review

DulalMali

Data Analytics Practice head at bse

Feb 9, 2020

Overall the solution is excellent.

Read full review

Mahdi Sharifmousavi

Lecturer at Amirkabir University of Technology

Aug 10, 2022

Offers a variety of methods to design queries and incorporates the regular SQL syntax within tasks.

Read full review

Sahil Taneja

Principal Consultant/Manager at Tenzing

May 5, 2023

The team members don't have to learn a new language and can implement complex tasks very easily using only SQL.

Read full review

Piotr Kalanski

Cloud Team Leader at TCL

Apr 26, 2020

The performance is one of the most important features. It has an API to process the data in a functional manner.

Read full review

Show 4 more reviews (out of 14)

Spark SQL Cons review quotes

Lucas Dreyer

Data Engineer at BBD

Jan 4, 2023

It takes a bit of time to get used to using this solution versus Pandas as it has a steep learning curve.

Read full review

SurjitChoudhury

Data engineer at Cocos pt

Nov 23, 2023

In terms of improvement, the only thing that could be enhanced is the stability aspect of Spark SQL.

Read full review

Keshav Mandal

Senior Analyst/ Customer Business and Insights Specialist at a tech services company with 501-1,000 employees

Nov 22, 2022

It would be beneficial for aggregate functions to include a code block or toolbox that explains its calculations or supported conditional statements.

Free Report: Spark SQL Reviews and More

Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: November 2024.

DOWNLOAD NOW

824,067 professionals have used our research since 2012.

Slaven Batnozic

CTO at Dokument IT d.o.o.

Aug 18, 2023

I've experienced some incompatibilities when using the Delta Lake format.

Read full review

Aria Amini

Data Engineer at Behsazan Mellat

Jul 26, 2023

It would be useful if Spark SQL integrated with some data visualization tools.

Read full review

Srinivasan Sugumar

Analytics and Reporting Manager at a financial services firm with 1,001-5,000 employees

Mar 18, 2020

Anything to improve the GUI would be helpful.

Read full review

DulalMali

Data Analytics Practice head at bse

Feb 9, 2020

The solution needs to include graphing capabilities. Including financial charts would help improve everything overall.

Read full review

Mahdi Sharifmousavi

Lecturer at Amirkabir University of Technology

Aug 10, 2022

There are many inconsistencies in syntax for the different querying tasks.

Read full review

Sahil Taneja

Principal Consultant/Manager at Tenzing

May 5, 2023

SparkUI could have more advanced versions of the performance and the queries and all.

Read full review

Piotr Kalanski

Cloud Team Leader at TCL

Apr 26, 2020

In the next update, we'd like to see better performance for small points of data. It is possible but there are better tools that are faster and cheaper.

Read full review

Show 4 more reviews (out of 14)