Spark does not encounter integration issues, particularly due to its utilization of JDBC connectors. These connectors facilitate seamless integration with third-party solutions. Furthermore, successful integration with tools like SAP HANA indicates its versatility in handling various data sources. Additionally, its performance surpasses Informatica in certain scenarios, especially when real-time streaming capabilities are crucial. It remains a preferred choice for businesses requiring efficient real-time data processing. I rate it an eight.
Chief Data-strategist and Director at Theworkshop.es
Real User
Top 10
2024-01-25T11:39:24Z
Jan 25, 2024
For those starting with Apache Spark Streaming, I recommend studying and understanding data relationships. While it might seem complex at first, there are helpful resources available. Overall, I would rate Apache Spark Streaming as a nine out of ten.
Apache Spark Streaming has very specific use cases and needs to be evaluated based on the needs of an individual before choosing it. Overall, I rate the solution an eight out of ten.
Chief Technology Officer at Teslon Technologies Pvt Ltd
Real User
Top 20
2023-06-08T10:44:00Z
Jun 8, 2023
I would highly recommend Spark Streaming for standard streaming or IoT use cases. The entire Spark ecosystem, including Spark Core, streaming, ML, and other components, can be highly beneficial. It's better to stick with the Spark ecosystem rather than use other platforms and frameworks. For streaming and IoT, Spark Streaming is a great choice. Overall, I would rate the solution an eight out of ten. The only issue I found, at least during the time I actively worked with it, was that it was resource-intensive, even for small-scale applications. In comparison, some other platforms, like Pulsar, had lighter resource consumption and performed better in terms of resource usage and associated costs. At least, to begin with, it performs better with the resource usage and dollar value associated with it. But at least to begin with it is a bit heavy and resource intensive, which is why I rate it an eight.
It's important to be familiar with Spark Streaming and Spark libraries, because familiarity with those scripts and coding languages makes it easier to work with the Spark code ecosystem to get the integrations of Spark Streaming or any Spark cluster creations. I rate this solution eight out of 10.
There are 18 to 20 people needed for maintenance with our 1,000 users. My advice to others is they need to fine-tune their job so the testing becomes important. Fine-tuning becomes important. It would be beneficial to have consulting or some background in the solution before using it. I rate Apache Spark Streaming an eight out of ten.
Head of Data Science at a energy/utilities company with 10,001+ employees
Real User
2022-04-11T16:30:40Z
Apr 11, 2022
We are a customer and end-user. We're using it in Azure, in Databricks. I don't know the exact version of Spark I'm using; it's one of the recent ones. I would rate the product an eight out of ten.
Chief Data-strategist and Director at Theworkshop.es
Real User
Top 10
2021-08-18T14:55:15Z
Aug 18, 2021
It's cheaper for companies to use cloud systems, however, you can implement it on-premise. We use the cloud. As it is the cloud, it's always on the latest version and updates itself regularly. I would rate the product at a nine out of ten. It's very good in terms of its capabilities and I have been very happy with it. I would recommend the solution to other users.
What is Streaming Analytics? Streaming analytics, also known as event stream processing (ESP), refers to the analyzing and processing of large volumes of data through the use of continuous queries. Traditionally, data is moved in batches. While batch processing may be an efficient method for handling huge pools of data, it is not suitable for time-sensitive, “in-motion” data that could otherwise be streamed, since that data can expire by the time it is processed. By using streaming...
Spark does not encounter integration issues, particularly due to its utilization of JDBC connectors. These connectors facilitate seamless integration with third-party solutions. Furthermore, successful integration with tools like SAP HANA indicates its versatility in handling various data sources. Additionally, its performance surpasses Informatica in certain scenarios, especially when real-time streaming capabilities are crucial. It remains a preferred choice for businesses requiring efficient real-time data processing. I rate it an eight.
For those starting with Apache Spark Streaming, I recommend studying and understanding data relationships. While it might seem complex at first, there are helpful resources available. Overall, I would rate Apache Spark Streaming as a nine out of ten.
Apache Spark Streaming has very specific use cases and needs to be evaluated based on the needs of an individual before choosing it. Overall, I rate the solution an eight out of ten.
I would highly recommend Spark Streaming for standard streaming or IoT use cases. The entire Spark ecosystem, including Spark Core, streaming, ML, and other components, can be highly beneficial. It's better to stick with the Spark ecosystem rather than use other platforms and frameworks. For streaming and IoT, Spark Streaming is a great choice. Overall, I would rate the solution an eight out of ten. The only issue I found, at least during the time I actively worked with it, was that it was resource-intensive, even for small-scale applications. In comparison, some other platforms, like Pulsar, had lighter resource consumption and performed better in terms of resource usage and associated costs. At least, to begin with, it performs better with the resource usage and dollar value associated with it. But at least to begin with it is a bit heavy and resource intensive, which is why I rate it an eight.
It's important to be familiar with Spark Streaming and Spark libraries, because familiarity with those scripts and coding languages makes it easier to work with the Spark code ecosystem to get the integrations of Spark Streaming or any Spark cluster creations. I rate this solution eight out of 10.
There are 18 to 20 people needed for maintenance with our 1,000 users. My advice to others is they need to fine-tune their job so the testing becomes important. Fine-tuning becomes important. It would be beneficial to have consulting or some background in the solution before using it. I rate Apache Spark Streaming an eight out of ten.
We are a customer and end-user. We're using it in Azure, in Databricks. I don't know the exact version of Spark I'm using; it's one of the recent ones. I would rate the product an eight out of ten.
It's cheaper for companies to use cloud systems, however, you can implement it on-premise. We use the cloud. As it is the cloud, it's always on the latest version and updates itself regularly. I would rate the product at a nine out of ten. It's very good in terms of its capabilities and I have been very happy with it. I would recommend the solution to other users.
I rate Apache Spark Streaming a six out of ten.