Azure Data Factory Reviews

For developers that are very accustomed to the Microsoft development studio, it's very easy for them to complete end-to-end data integration.

One of the features that still is in development is data privacy to the cloud side of the SAP integration.

I have been using Azure Data Factory for 3 years. 

I rate the stability a 9 out of 10. 

6 developers are using the solution at present. 

The initial setup is not very straightforward. I rate it a seven out of ten. 

The pricing is a bit on the higher end. 

Overall, I rate the solution an 8 out of 10. 

We use Data Factory for automating ETL processes, data management, digital transformation, and scheduled automated processes. My team has about 11 people, and at least five use Data Factory. It's mostly data engineers and analysts. 

Each data analyst and engineer manages a few projects for clients. Typically, it's one person per client, but we might have two or three people managing and building out pipelines for a larger project.  

It's cloud-based, allowing multiple users to easily access the solution from the office or remote locations. I like that we can set up the security protocols for IP addresses, like allow lists. It's a pretty user-friendly product as well. The interface and build environment where you create pipelines are easy to use. It's straightforward to manage the digital transformation pipelines we build.

Data Factory has so many features that it can be a little difficult or confusing to find some settings and configurations. I'm sure there's a way to make it a little easier to navigate.

In the main ADF web portal could, there's a section for monitoring jobs that are currently running so you can see if recent jobs have failed. There's an app for working with Azure in general where you can look at some segs in your account. It would be nice if Azure had an app that lets you access the monitoring layer of Data Factory from your phone or a tablet, so you could do a quick check-in on the status of certain jobs. That could be useful.

We've been using Azure Data Factory for about three years.

I've been happy with it overall. I don't think we've had any major issues. We've been able to do what we needed, whether connecting to different data sources or setting up different types of transformations and processes. 

It's a cloud solution, so it's inherently scalable. I don't know If we have to raise the limits on resources like clusters and processing power or if it will just automatically scale up. I can't remember offhand. 

We managed the same actions with a combination of tools. We used SFTP servers to move data from one place to another. We used scripts for loading and some other stored procedures or processes for data transformation within a database. It took two or three pieces of technology or systems to manage the same types of operation. Data Factory lets us consolidate those steps into a single pipeline. 

Setting up Azure Data Factory is pretty straightforward. We had an Azure account already, and Data Factory was just something we could add as an extra service. We had to create instances and pipelines, and it took us about two weeks to get our first pipelines scheduled and running. 

We do everything in-house.

We see a return on Data Factory if we compare the time and effort that would be necessary to perform the equivalent processes manually. 

I'm not too familiar with the cost, but I believe we're reasonably happy with what we're paying. My understanding is that the cost of Data Factory is tied to consumption. It depends on the amount of data or the number of pipelines running, and the cost varies from month to month depending on the usage. 

You'll obviously pay more if you're scheduling heavy digital transformation processes to run every hour, but I don't think there are any other hidden costs or anything extra. When you set up a new account, you have a trial period that enables you to create a test pipeline or process that's typical of your use case and then do a benchmark test to see if Data Factory can achieve the efficiency you need. You'll also get some idea of how much the process will cost to run. From there, it's straightforward to do a cost evaluation or comparison to see if it's the right fit for your company. 

We were looking for a single solution, and Data Factory was the first one that interested us. I don't think we looked at many others. We were pretty set on Azure, and Data Factory seemed to fit our needs, so we didn't make a full comparison with the alternatives.

I rate Azure Data Factory nine out of 10. It isn't perfect, but it's solid. Data Factory has improved how we deal with various aspects of Azure. It has always met our needs in terms of the transformations and jobs we want to create and schedule. 

Azure Data Factory is an integration tool, an orchestration service tool. It’s for data integration for the cloud.

The solution is okay.

Some stuff can be better, however, overall it's fine.

The performance and stability are touch and go.

The deployment should be easier.

We’d like the management of the solution to run a little more smoothly.

I’ve used the solution for three to five years.

The solution could be more stable. It’s touch and go. It’s not 100%.

For Azure Data Factory, scalability doesn't mean really too much. However, in some scenarios, you can play with it a little bit.

Azure Data Factory is not for users. Is for engineers, for developers. The end user does not interact with Azure Data Factory. There might be 20 developers on the solution currently.

I don't remember a particular scenario right now where I reached out to support. However, when you work with Azure Services, here and there, you might get into some challenges, and maybe sometimes you reach out to Microsoft. That said, I don't remember a particular scenario right now.

It’s hard to describe the installation. It’s not overly complex or extremely easy.

The point is almost true for all services. If you want to do something simple and quick, then it's just a couple of clicks, and it's there. However, in real production environments, it's not like that. You have to arrange a lot of things. You have to set up a lot of things. You have to configure a lot of things correctly in an automated way. That is totally different than just a couple of clicks. You have to put in the work. If you ask me how easy it is, yeah, it is easy. However, it can also be really, really complicated depending on the scenario.

As far as I know, there isn’t any licensing per se for this solution.

I’d rate the solution eight out of ten overall.

We are using this solution to gather information from SCADA systems, analyze it using AI and machine learning, and then sending the results to our users. They receive and view the data using the Power BI interface.

The integration with the whole environment is smooth and transparent.

The reason that we implemented this product is for the full integration with the whole Azure environment. It is very important because you don't have to deal with security, identity flow, or audit flow.

The security of the agent that is installed on-premises is very good. This is another important feature for us.

It comes with a lot of connectors out of the box, including support for SQL, Oracle, SAP, and ODBC.

The pricing scheme is very complex and difficult to understand. Analyzing it upfront is impossible, so we just decided to start using it and figure out the costs on a weekly or monthly basis.

We have just begun using Azure Data Factory within the past two or three months and it is not fully rolled out yet.

We have no issues with technical support. We are working closely with Microsoft partners. There were a couple of problems during the installation that were solved on the fly, and otherwise, we haven't had and trouble.

We started with iConduct and as we migrated to the Azure environment, we began the process of switching to the Microsoft Azure Data Factory.

The initial setup was not very complex and the deployment was very quick. We were set up within a matter of days, or perhaps a week.

We received help from one of the Microsoft partners, who handled the installation for us.

To this point, we are still learning the system and have only tried a very simple data flow. At this point, we haven't had any issues.

I would rate this solution an eight out of ten.

The use cases are more related to logistics, our finance, and back-office activity.  

The most valuable part of this product is the ease of use. It is easy to use and rather intuitive. Because it is easy to use, you can do things with it easily. The more things make your work easy, the more valuable they are.  

Because I have not really done a really deep benchmark against competitors, I may not be familiar enough with the potential of competing products and capabilities to be able able to say what is missing or should be improved definitively.  

From my perspective, the pricing seems like it could be more user-friendly. Of course, nothing is ever as inexpensive as you want.  

Perhaps one good additional feature would be incorporating more ways to import and export data. It would be nice to have the product fit our service orchestration platform better to make the transfer more fluid.  

We started using this product a year ago.  

The stability of the product is good.  

The scalability seems okay. As we have only been using it for a short time, it is hard to say more. We are not currently planning to scale usage dramatically at this point but of course we would like to grow. On a scale from one to ten and from what I know, I would say scalability is an eight-out-of-ten. I can't be sure exactly how many people are using the system, but we have hundreds of thousands of users currently. Internally, I would say we use the product often.  

I have not had a reason to be in touch with technical support, but I don't know whether others in the organization have been in touch with them. As far as I know, there has been no reason to be.  

The initial setup was not simple and it was not complex. It was in the middle.  

I would say it took two months for the deployment.  

We have a department of developers that implemented the product. The deployment happened before I joined the organization.  

The advice I would give to someone who is looking to implement this product is to understand the IT technology of the product first and why it would be needed. That is the point where you have to start. Next, you have to understand if the product itself fits your organizational needs. That is you have to look at the business requirements and see whether the product really fits the organization and solves the problems while conforming to the business model.  

On a scale from one to ten where one is the worst and ten is the best, I would rate the product overall as an eight-out-of-ten.  

I am a manager of a team that uses this solution.

Azure Data Factory is primarily used for data integration, which involves moving data from sources into a data lake house called Delta Lake.

It's fairly simple to use. The most valuable feature of this solution would be ease of use.

It does not appear to be as rich as other ETL tools. It has very limited capabilities. It simply moves data around. It's not very good after that because it's taking the data to the next level and modeling it.

I have been working with Azure Data Factory for less than a year.

I would say that we are working with the latest version.

The stability of Azure Data Factory is good. The performance is good.

I haven't had to scale this solution as of yet.

We have six people in our company who use this solution.

Increasing the usage is not on our strategy pathway.

I have not contacted technical support. I have not required any yet.

I have had very little contact with Microsoft support, but it's been good.

I have also worked with Talend. I didn't switch products, but rather companies.

Talend is a more robust enterprise-wide solution that can handle everything from start to finish, whereas Azure Data Factory is more of an ingestion tool.

I was not involved with the initial setup.

We are an enterprise that uses an integrator.

It does not require any maintenance, it's simple.

I don't see a cost; it appears to be included in general support. I have been told that you have to be very careful because it can blow out. I have not experienced it yet, but I've been warned that as Azure ingestion increases, the costs can rise.

In my opinion, the price is competitive.

It's a good tool, a good product that does what it's supposed to do well, which is ingesting data from a source to your target, to another cloud, to another source. Just be conscious to monitor your costs.

I would rate Azure Data Factory an eight out of ten.

Our customers use it for data analytics on a large volume of data. So, they're basically bringing data in from multiple sources, and they are doing ETL extraction, transformation, and loading. Then they do initial analytics, populate a data lake, and after that, they take the data from the data lake into more on-premise complex analytics.

Its version depends on a customer's environment. Sometimes, we use the latest version, and sometimes, we use the previous versions.

It is very modular. It works well. We've used Data Factory and then made calls to libraries outside of Data Factory to do things that it wasn't optimized to do, and it worked really well. It is obviously proprietary in regards to Microsoft created it, but it is pretty easy and direct to bring in outside capabilities into Data Factory.

It is very flexible. You can build any features you want.

There is always room to improve. There should be good examples of use that, of course, customers aren't always willing to share. It is Catch-22. It would help the user base if everybody had really good examples of deployments that worked, but when you ask people to put out their good deployments, which also includes me, you usually got, "No, I'm not going to do that." They don't have enough good examples. Microsoft probably just needs to pay one of their partners to build 20 or 30 examples of functional Data Factories and then share them as a user base.

I have been using this solution for the last five years, but probably, the last three years have been significant.

It has been stable. I have not experienced any issues.

It is decent for most things. I'm not sure if it is necessarily intended for large volume and high-speed streams of data. By large, I mean really big, but for pretty much anything that most users would want to do, including ourselves, it is fine. Our clients are large government organizations.

It scales fine within its environment. You can literally throw another Data Factory in or replicate one and do things pretty quickly. So, it is not at all hard to increase your processing footprint, but you have to pay for it. It doesn't end up being quite expensive. Although I haven't really done it, I would suspect that if I did the equivalent in AWS, Azure would be more expensive than AWS because of the way they price data.

They're all right. I would rate them a seven out of 10. They do fine, but there is a lot that they don't do.

I'm not sure if even Microsoft has enough SMEs from a user point of view. They are helpful for getting it set up, making it work, and helping you figure out why it doesn't work. If you want to ask them about something that you are trying to do, they'll try to direct you to a partner, which is fine, but the partners also don't necessarily have an experience. It is Catch-22. There aren't a lot of people out there with Azure experience because Azure started to be in demand only over the last two years.

The customer used a lot of homebrew stuff. They were doing a lot of internal stuff and some Oracle stuff. They were doing things, and they made a workaround and said, "Okay, we'll bring it into Oracle Database, and then we'll do all these things to it." We're like, "Okay, that works, but then you're taking it out of that database and putting it over into the data lake. I don't understand why are you doing that?" That's what they were doing.

It is pretty straightforward. Devil is in the details, but you can easily get up and running in a day with Data Factory. Anybody who is comfortable in Azure can set up Data Factory, but it takes experience to know what it can and can't do or should and shouldn't do.

It is proven, and it works. Make sure you have a well-defined use case and build a quick prototype to ensure that it, in fact, does what you need. Give yourself some benchmarks. That's exactly what we did. We defined the use case, and then we set up Data Factory. We found a couple of things that it didn't do. We figured out a way to work around those things and have it do those things. After that, we confirmed it. It is operational, and it is doing its job. It has been pretty much error-free since then.

It would become easier to use as more people become Azure-capable. If I want to find an AWS SME, I can get tons. They're expensive, but I have them. If I want to find an Azure SME, I usually have to create them. Azure was later to market than AWS. So, there are fewer people who are experts in Azure, and they are in high demand.

I would rate Azure Data Factory a nine out of 10. They just don't have enough good examples out there of things.

The primary use case of this solution is for data integration.

It has built-in connectors for more than 100 sources and onboarding data from many different sources to the cloud environment.

It has everything we needed.

Being able to post your feedback and queries is a very good feature that is offered by Azure Data Factory.

Understanding the pricing model for Data Factory is quite complex. It needs to be simplified, and easier to understand.

We have experienced some issues with the integration. This is an area that needs improvement.

I have been using this solution for almost two years.

So far it's been stable. We have not experienced any issues.

I haven't put much thought into scalability.

I have contacted technical support.

If there are any queries, they have the provision to post them in the Data Factory GUI and we can contact the team directly. This is a very nice feature.

Any feedback or improvements that we post is acknowledged and taken care of.

The initial setup was straightforward. It was not complex.

Pricing is quite complex.

I have had feedback from many people and many of my team members, and they say that it is difficult to understand. 

Understanding the pricing of Data Factory is quite complex. 

It is not presented in a straightforward way.

I would definitely recommend this solution to anyone who is interested in using it.

I would rate Azure Data Factory an eight out of ten.