System Engineer - Cloud Platform at a computer software company with 1,001-5,000 employees
Real User
Top 20
2024-08-30T17:29:26Z
Aug 30, 2024
One challenge we face is when we want to update the version, for example, from 3.6 to 3.7. It will spawn new nodes, and then there's rebalancing and syncing from other brokers. There's high CPU usage during this process, so the solution can't be used for a while, causing some downtime in our services. To tackle this challenge, we schedule maintenance updates during low-traffic periods when there's less risk and fewer users use the services.
What is Streaming Analytics? Streaming analytics, also known as event stream processing (ESP), refers to the analyzing and processing of large volumes of data through the use of continuous queries. Traditionally, data is moved in batches. While batch processing may be an efficient method for handling huge pools of data, it is not suitable for time-sensitive, “in-motion” data that could otherwise be streamed, since that data can expire by the time it is processed. By using streaming...
One challenge we face is when we want to update the version, for example, from 3.6 to 3.7. It will spawn new nodes, and then there's rebalancing and syncing from other brokers. There's high CPU usage during this process, so the solution can't be used for a while, causing some downtime in our services. To tackle this challenge, we schedule maintenance updates during low-traffic periods when there's less risk and fewer users use the services.