Try our new research platform with insights from 80,000+ expert users
Spark SQL Logo

Spark SQL pros and cons

Vendor: Apache
3.9 out of 5
173 followers
Post review
 

Spark SQL Pros review quotes

Lucas Dreyer - PeerSpot reviewer
Jan 4, 2023
Certain data sets that are very large are very difficult to process with Pandas and Python libraries. Spark SQL has helped us a lot with that.
SurjitChoudhury - PeerSpot reviewer
Nov 23, 2023
Spark SQL's efficiency in managing distributed data and its simplicity in expressing complex operations make it an essential part of our data pipeline.
KM
Nov 22, 2022
The solution is easy to understand if you have basic knowledge of SQL commands.
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
816,406 professionals have used our research since 2012.
SB
Aug 18, 2023
I find the Thrift connection valuable.
Aria Amini - PeerSpot reviewer
Jul 26, 2023
One of Spark SQL's most beautiful features is running parallel queries to go through enormous data.
SS
Mar 18, 2020
The speed of getting data.
DM
Feb 9, 2020
Overall the solution is excellent.
Mahdi Sharifmousavi - PeerSpot reviewer
Aug 10, 2022
Offers a variety of methods to design queries and incorporates the regular SQL syntax within tasks.
Sahil Taneja - PeerSpot reviewer
May 5, 2023
The team members don't have to learn a new language and can implement complex tasks very easily using only SQL.
PK
Apr 26, 2020
The performance is one of the most important features. It has an API to process the data in a functional manner.
 

Spark SQL Cons review quotes

Lucas Dreyer - PeerSpot reviewer
Jan 4, 2023
It takes a bit of time to get used to using this solution versus Pandas as it has a steep learning curve.
SurjitChoudhury - PeerSpot reviewer
Nov 23, 2023
In terms of improvement, the only thing that could be enhanced is the stability aspect of Spark SQL.
KM
Nov 22, 2022
It would be beneficial for aggregate functions to include a code block or toolbox that explains its calculations or supported conditional statements.
Learn what your peers think about Spark SQL. Get advice and tips from experienced pros sharing their opinions. Updated: October 2024.
816,406 professionals have used our research since 2012.
SB
Aug 18, 2023
I've experienced some incompatibilities when using the Delta Lake format.
Aria Amini - PeerSpot reviewer
Jul 26, 2023
It would be useful if Spark SQL integrated with some data visualization tools.
SS
Mar 18, 2020
Anything to improve the GUI would be helpful.
DM
Feb 9, 2020
The solution needs to include graphing capabilities. Including financial charts would help improve everything overall.
Mahdi Sharifmousavi - PeerSpot reviewer
Aug 10, 2022
There are many inconsistencies in syntax for the different querying tasks.
Sahil Taneja - PeerSpot reviewer
May 5, 2023
SparkUI could have more advanced versions of the performance and the queries and all.
PK
Apr 26, 2020
In the next update, we'd like to see better performance for small points of data. It is possible but there are better tools that are faster and cheaper.