I think you have to focus your workload, human resource and data integration strategy.
For example, if you would like to load data incrementally from some RDBMS and would like to manage data linage, you have to review the data management feature of tools. If that feature is not important and throughput is important for you, you have to focus data processing power of the tool.
There is no one best solution in the market. You have to define your requirements before selecting your criteria.
I recommend, if you would like to make a design independently of cloud vendors like GCP, AWS or Azure, you can look at the Informatica Cloud product family. There are really good solutions for data integration.
What is Streaming Analytics? Streaming analytics, also known as event stream processing (ESP), refers to the analyzing and processing of large volumes of data through the use of continuous queries. Traditionally, data is moved in batches. While batch processing may be an efficient method for handling huge pools of data, it is not suitable for time-sensitive, “in-motion” data that could otherwise be streamed, since that data can expire by the time it is processed. By using streaming...
AWS Glue and Azure Data factory for ELT best performance cloud services.
ETL Developer responsibilities include extracting, transforming, loading ETL processes and data integration. Here’s what to know about an ETL developer’s needed skills, salary and how to become one: https://www.cleveroad.com/blog/how-to-outsource-software-development/
I think you have to focus your workload, human resource and data integration strategy.
For example, if you would like to load data incrementally from some RDBMS and would like to manage data linage, you have to review the data management feature of tools. If that feature is not important and throughput is important for you, you have to focus data processing power of the tool.
There is no one best solution in the market. You have to define your requirements before selecting your criteria.
I recommend, if you would like to make a design independently of cloud vendors like GCP, AWS or Azure, you can look at the Informatica Cloud product family. There are really good solutions for data integration.