Azure Data Factory Reviews

Our company uses the solution to extract, transform, and load the data into the database.

Feature-wise, one of the most valuable ones is the data flows introduced recently in the solution.

Currently, our company requires a monitoring tool, and that isn't available in Azure Data Factory. Although the platform displays which pipelines are running, it doesn't offer a monitoring tool that allows for the sequential execution of pipelines and the ability to visualize end-to-end data flow. As such, this feature is currently missing from the platform.

I have been using Azure Data Factory for more than six years. Also, I am an end-user of the solution, and I initially used to work on Azure Data Factory V1. Now, I have switched to Azure Data Factory V2.

It is a stable solution. Stability-wise, I rate the solution an eight or nine out of ten.

Scalability-wise, I rate the solution a seven or eight out of ten. So, scalability can be improved. Also, there are around 150 people in my company using the solution. Moreover, we use the solution daily in our company.

I rate the technical support between eight to nine out of ten.

Positive

Previously, I was using Informatica. My company wanted to shift to a solution that could be deployed on the cloud, so we chose Azure Data Factory.

The solution's initial setup process was easy. On a scale where one is difficult and ten is easy, I rate the initial setup process an eight out of ten. The solution is deployed on the cloud.

Since multiple projects are going on in my organization, there is no uniformity in the time taken to deploy the solution in our company. However, I can say that it only takes a few days to carry out the deployment process.

Our organization has multiple project teams, so each team carries out its deployment process.

To give an average, I would consider that if there are fifty ongoing projects in our company, and if we consider a person from each project, fifty people are needed for the deployment and maintenance process.

The solution's implementation process was done with our in-house team's help.

I cannot comment on the pricing parts since our company's admin team handles it.

Those who want to move to a cloud platform can choose Azure Data Factory since it is the best tool. Since certain improvements are required in the solution, I rate the overall solution an eight out of ten.

My clients use Data Factory to exchange information between the on-premises environment and the cloud. Data Factory moves the data, and we use other solutions like Databricks to transform and clean up the data. My teams typically consist of three or four data engineers.

I like how you can create your own pipeline in your space and reuse those creations. You can collaborate with other people who want to use your code.

DataStage is easier to learn than Data Factory because it's more visual. Data Factory has some drag-and-drop options, but it's not as intuitive as DataStage. It would be better if they added more drag-and-drop features. You can start using DataStage without knowing the code. You don't need to learn how the code works before using the solution.

I think the communication about the ADA's would be interesting to see in the platform. How to interact with those kind of information and use it on your pipelines.

I have used Data Factory for eight months.

I have never experienced downtime with Data Factory. 

It isn't that expensive to scale Data Factory up. My client can ask for more resources on the tool, and paying more is never an issue. 

I rate Azure support seven or eight out of 10. There is room for improvement. Sometimes, you don't know where the errors originate. You have to send a ticket to Azure, and they take two or three days to respond. The issue may resolve itself by then. The problem is fixed, but you don't know how to prevent it or what to do if it happens in the future. 

The data transfer has stopped a few times for unknown reasons. We don't know if the resources are insufficient or if there is a problem with the platform. By the time we hear back from Microsoft, the issue has been resolved.

Positive

Data Factory is effortless to set up.

I rate Azure Data Factory nine out of 10. When implementing Data Factory, you should document where you are building so you can pass that information. Sometimes you build something for a specific purpose, but you can use that information for other solutions. If you have a community where you are building things, you can reuse them on the platform, so don't need to build everything from scratch.

Azure Data Factory allows us to provide BI service. We pull the data and put it into Synapse. From there, we create our dimension fact tables that are being used for reporting. 

The most valuable feature of Azure Data Factory is the improved flexibility compared to SSIS that we previously used for our ETL transformation. I also enjoy the ease of use for the backend JSON generator, the deployment solution, and the template management. All we need to do is create ARM templates.

Microsoft is constantly upgrading its product. Changes can happen every week. Every time you open Data Factory you see something new and need to study what it is. I would like to be informed about the changes ahead of time, so we are aware of what's coming.

In future releases, I would like to see Azure Data Factory simplify how the information of logs is presented. Currently, you need to do a lot of clicks and go through steps to find out what happened. It takes too much time. The log needs to be more user-friendly.

I have been using Azure Data Factory for two years.

Scalability depends on the use case. 

As far as customer service and support with Azure Data Factory, we are not always satisfied with the response time. However, once they attend to the issue, everything is good.

Positive

All we needed to do was create ARM templates and deployment is easy.

We deployed in-house. For deployment, we use ARM templates that are a part of Azure's deployment strategy. It's not only available for Data Factory, it is built in. It links with DevOps, then the ICD integration.

Azure Data Factory is a good tool. Given that the data platform ecosystem is provided by Microsoft, you know it is good.

I would rate the solution an eight out of ten overall.

We are not using this product specifically as a data factory. We have taken Synapse Analytics as the entire component for the data warehousing solution. Azure Data Factory is one of the components of that, and we are using it for ETL. 

Prior to this, we did not have a proper data warehousing solution. Instead, we had segregation between different tools like Oracle Data Warehouse, Exadata, and other products. Now, most of the tools that we have are from Microsoft, including Power BI, which has been rolled out throughout the organization. Synapse was the better choice for us to implement, as it has a lot of out-of-the-box connectors that we can utilize for data transformation and organization. 

The best part of this product is the extraction, transformation, and load. In fact, we have found that the three of them work quite well. We are implementing the cloud-based system right now.

We see a lot of improvement with the most recent version of this solution. Some of the new features are very important to us.

The need to work more on developing out-of-the-box connectors for other products like Oracle, AWS, and others.

We have been working with Azure Data Factory for approximately six months. We are still implementing and it is not live, yet, but we expect it to be in 2021.

I have found it to be quite stable. Here and there, there could be some issues and problems but overall, I'm okay with the product.

Scalability is one of the points that we were looking for because we are hosting approximately two terabytes of data and we expect that it will grow at least five times over the next two years. This is one of the reasons that we adopted this solution.

In perhaps a year, we will increase our usage.

The technical support from Microsoft is quite good. if you get good resources and they can provide you with free consulting, then it is quite good. However, when you purchase paid consulting and dedicated support, it is quite costly compared to the market.

I don't think that the initial setup was very complex. We have quite an advanced IT infrastructure team and the Microsoft FastTrack team also helped us a lot during the programming of the development and setup.

I would not say that this product is overly expensive. It is competing with the other providers, and they have almost the same pricing model.

In general, I would recommend this product. However, it depends on the target IT ecosystem. If they are utilizing a lot of Microsoft products like Power BI, Office, Project, SharePoint, and so forth, it's better to implement Data Factory because it will reduce a lot of effort spent to consume data from other sources.

At this point, I can only rate based on my pre-implementation experience, so I would rate this solution an eight out of ten.

We use the product for data warehouses. It helps us to load data to warehouses. 

The tool's most valuable features are its connectors. It has many out-of-the-box connectors. We use ADF for ETL processes. Our main use case involves integrating data from various databases, processing it, and loading it into the target database. ADF plays a crucial role in orchestrating these ETL workflows. 

The tool's visual interface is good. The ADS scheduling feature impacts data management by determining when jobs must be run and setting up dependencies. This capability eliminates the need to rely on enterprise data scheduling tools. 

When working with AWS, we have noticed that the difference between ADF and AWS is that AWS is more customer-focused. They're more responsive compared to any other company. ADF is not as good as AWS, but it should be. If AWS is ten out of ten, ADF is around eight out of ten. I think AWS is easier to understand from the GUI perspective compared to ADF.

I have been using the product for 6 months. 

ADF is stable. 

I rate the tool's scalability an eight out of ten. 

The tool's deployment is easy. The deployment typically takes around two to three days to set up. However, the duration may vary depending on factors such as the number of integrated endpoints. In our company, the deployment team had three to four people. This team consisted of an IT engineer, a network engineer, and an ETL admin.

We still haven't required much maintenance since we're still in the development phase. However, as time progresses and we move into production, we'll better understand the maintenance requirements.

ADF is cheaper compared to AWS. 

The tool has met our projects' growing data needs effectively so far. I rate it an eight out of ten. 

In my company, we use Azure Data Factory for everything related to data warehousing. Depending on my customer's wants, I will use SSIS or Azure Data Factory. If my customers want Fivetran, I will use it for them. If the customer wants a suggestion from me on what they should use, then I will look at what they have today and their skills. According to the inputs I receive from my customers, I will recommend what makes more sense for a particular customer. I can be called a software agnostic.

I can do everything I want with SSIS and Azure Data Factory.

There aren't many third-party extensions or plugins available in the solution. Adjunction or addition of third-party extensions or plugins to Azure Data Factory can be a great improvement in the tool. Creation of custom codes, custom extensions, or third-party extensions, like Lookup extension, should be made possible in the tool.

I am unsure if Azure Data Factory bridges the gap between on-premises, cloud, and hybrid solutions. I would like to see a version that would work equally well in both on-premises and cloud environments. I would like to see the aforementioned offerings made to customers as valuable alternatives to the old SSIS tool.

I have been using Azure Data Factory for many years. I started using the tool since it was called DTS and then, later, SSIS. I currently use Microsoft SQL SSIS 2019.

The solution is deployed on the cloud.

Overall, I rate the solution an eight out of ten.

As a management consultancy company, we help our clients deploy Azure Data Factory or any other cloud-based solution depending on data integration needs. Regarding how we use Azure Data Factory within our company, we are on the Microsoft Stack, so we use the solution primarily for data warehousing and integration.

The feature I found most helpful in Azure Data Factory is the pipeline feature, including being able to connect to different sources.

I also found running Python codes whenever you need to valuable in Azure Data Factory, especially for certain features of the solution, such as data integrations, aggregations, and manipulations.

Azure Data Factory also has built-in security, which is another valuable feature.

I also like that you get access to the whole Azure suite through Azure Data Factory, so the overall architecture design, defining security and access, role-based access management, etc. It's helpful to have the whole suite when designing applications.

Areas for improvement in Azure Data Factory include connectivity and integration.

When you use integration runtime, whenever there's a failure, the backup process in Azure Data Factory takes time, so this is another area for improvement.

Database support in the solution also has room for improvement because Azure Data Factory only currently supports MS SQL and Postgres. I want to see it supporting other databases.

If you want to connect the solution from on-premises to the cloud, you will have to go with a VPN or a pretty expensive route connection. A VPN connection might not work most of the time because you have to download a client and install it, so an interim solution for secure access from on-premise locations to the cloud is what I want to see in Azure Data Factory.

I've been using Azure Data Factory for about a year now.

Azure Data Factory is very stable, so it's a four out of five for me. In some instances, the solution failed, but I wouldn't wholly blame Azure Data Factory because my company connected to some on-premise databases in some cases. Sometimes, you'll get errors from self-hosted integration, faulty connections, or the on-premise server is down, so my rating for stability is a four.

Scalability-wise, Azure Data Factory is a four out of five because Microsoft is still developing certain tiers, which means you can't upgrade an older skill or tier. In contrast, the more modern, newer tiers could be upgraded easily. Rarely will you get stuck in one platform where you have completely destroyed that container and then fit a new container. Most of the time, Azure Data Factory is pretty easy to scale.

We haven't used Microsoft support directly because whenever we have issues with Azure Data Factory, we can find resolutions through their online documentation.

We're using both Azure Data Factory and SSIS.

We had several in-house solutions, but we moved to Azure Data Factory because it was straightforward. From a deployment standpoint, the solution comes with different services, so we didn't have to worry about separate hardware or infrastructure for networking, security, etc.

The initial setup for Azure Data Factory was easy, so I'd rate the setup a four out of five.

The implementation strategy was looking into what my organization needed overall, then planning and direct deployment. My company first did a test, a dummy version, then a UAT with stakeholders before going into production.

It took about two months to complete the deployment for Azure Data Factory.

An in-house team, the digital data engineering team, deployed Azure Data Factory.

We're still computing the ROI from Azure Data Factory. It's too early to comment on that.

My company is on a monthly subscription for Azure Data Factory, but it's more of a pay-as-you-go model where your monthly invoice depends on how many resources you use.

On a scale of one to five, pricing for Azure Data Factory is a four.

It's just the usage fees my company pays monthly. No support fees because my company didn't need support from Microsoft.

If you're not using core Microsoft products, the cost could be slightly higher, for example, when using a Postgres database versus an MS SQL database.

My company uses Azure Data Factory, SSIS, and for a few other instances, Salesforce.

My company currently has about fifty Azure Data Factory users, but not directly exposed to the solution compared to the developers; for example, members of corporate management and other teams apart from the development team are exposed to Azure Data Factory.

Shortly, there could be about two hundred users of Azure Data Factory within the company.

The developer team working directly on Azure Data Factory comprises ten individuals.

For the maintenance of the solution, my company has two to three staff, but it could reach up to eight or ten for the entire product. It's a mix of engineers and business analysts who handle Azure Data Factory maintenance.

I'd rate Azure Data Factory as eight out of ten.

My company is an end user of Azure.

We use this solution to perform ELTs so that we do not need to keep code within a database.

The overall performance is quite good.

Occasionally, there are problems within Microsoft itself that impact the Data Factory and cause it to fail.

I've worked with this solution for two and a half years.

I wouldn't consider it to be stable since it fails at times.

The solution is scalable.

Support is quite slow and they have bugs that they are unaware of and claim that that is how the system is supposed to work.

My company used Informatica PowerCenter in the past but I was not involved in that.

The initial setup was quick and easy. The whole process took about fifteen minutes. We have about a hundred users at the moment and have plans to increase.

Two of our in-house developers were able to complete the setup.

This solution has good performance but could use better stability. I would rate this a nine out of ten.