We use this solution for extracting data from various databases and saving it in our data warehouse.
We use the on-premise deployment model.
We use this solution for extracting data from various databases and saving it in our data warehouse.
We use the on-premise deployment model.
My team is facing problems regarding the database connectors, which are not available. The MySQL connectors need to be purchased from outside vendors. They should provide connections for more SQL databases, free of charge.
The performance of this solution is not as good as other tools in the market. Compared to the same job is running in a different tool, it will take longer using SSIS.
This is a stable solution.
This solution is scalable.
The number of people I have using this solution depends on the size of the project. Normally, I need three to five ETL developers. Sometimes, if the project is big enough, then I will need more.
I have not contacted Microsoft Technical Support for this solution, although we have sometimes accessed the internet to research problems that we face.
In my previous company, I was leading a team who were working with Informatica. Here, they stick to Microsoft technologies and are unwilling to change.
The initial setup of this solution is very straightforward. In a few hours, everything was up and running.
The decision to use this particular solution includes many factors. Some companies do not want to purchase a license for another product because this one comes included with the database.
SSIS worked well for small or medium-sized Projects. For larger projects with huge data, I believe that you should search for another solution as you will need to do manual fine tuning. Additionally, some components such as SCD will show unexpected errors with huge data.
As Microsoft is very slow in providing updates and enhancements to SSIS, I see that the future for Integration projects in Saudi Arabia goes towards other vendors products such as Informatica powercenter, IBM DataStage, and Oracle ODI.
Compared to other Integration tools, I would rate it a six out of ten.
Movement of data and creation of files. ALl the typical things that you would have a ETL solution do. Data movements were in the millions and no calculations were completed. This means it was always a select * from where ever it was coming from and going to. Light translations like concatenation was being used.
SSIS was easily adaptable to our group. It was cheaper than the other tools that we compared it to, however I feel that we got what we paid for.
The packaging and how it is organized is good for someone that really has never seen ETL before.
Scalability of SSIS needs some improvement. Seems to get sluggish as soon as we hit a high volume of data.
Again it failed a lot and by a lot I mean every day. The failures were false alarms and caused many sleepless night for our company that I used to work for.
SSIS is good for smaller shops that don't really have a high volume of data.
I would rate the customer service as poor.
We were using Hyperion Application Link. We switched because HAL was being sunset.
Never participated in the initial setup.
In-house.
For the money, it's a decent tool. However, if the budget was larger I would have gone with a different tool
Look at how this product is sold to you. Ask yourself, am I getting everything that I need. Its more expensive to get the additional adapters after the fact.
We looked at ODI, Informatica, and DataStage. All three we had in-house. ODI was the better option and after dealing with SSIS for only a few months, we ended up using ODI.
Curious people's experiences when they mention "fail a lot" or scalability. I've used many ETL tools in my career - most of them very expensive and I'd put SSIS up against any of them for reliability and performance (within limits).
Scalability is largely comparing to expectations and it depends on your expectations. I think people too often compare completely different architectures and are surprised when they scale differently. SSIS is single server. No MPP going on here folks. You get a lot more than you've paid for (which is really nothing is you already own SqlServer). SSIS sure beats the open source stuff I've seen out there that really sucks. Try Pentaho written in Java if you want slow. I've read where people have custom coded front ends to fire multiple SSIS servers and there's ways of partitioning data flows but if you are getting into that you might be on the wrong tool. Consider the opposite - most people are running SSIS on the target database box so its competing with the database server as well as not utilizing more than one server. I'm doing that and actually getting quite great performance (again - its all about expectations).
So yes if you need millions per second SSIS is not the tool you want. My benchmark with SSIS is @10,000 rows per second to stage large rows through a data flow. I'm guessing if you need a lot faster than that you have significant volumes and big pockets so why would you look at a free tool that's designed to be installed on a database server?
As for failing, it would only fail due to buffers if you did something with altering buffers that you should not have done. That would be your bad sorry. Or you're doing something else silly like running on 4gb VM and didn't set a max memory on the Sql Server so basically everything crawls or fails. Hey - some of you are laughing but some are probably scratching their heads and asking, so what's wrong with that?
We use this solution for ETL, which includes data summation and cleaning.
This solution used in an on-premise deployment, for now.
I have used most of the standard SQL features, but the ones that stand out are the Data Flows and Bulk Import.
The synchronous processing needs to be improved. For batch processing, it works fine, but when you start to do real-time processing, I find that this solution is not strong, depending on how you use it. If you use it for short batches, micro batching, that might work, but it is not as good for queuing real-time processing. This solution needs full support for real-time processing.
The solution needs better support for XML and JSON.
I use this product extensively, on a daily basis. It is stable.
Over time, I think we'll most likely start to decrease usage. This will happen as we move to more real-time processing, and we will most likely start to do more queue processing. In terms of batch processing, it will scale down considerably.
In the catalog, it's supposed to be scalable. I think that it has support for an SQL cluster.
In my opinion, I think it's a bit more limited in terms of scalability, although it scales with the database. I would say that the scalability is intermediate in terms of being able to launch multiple instances, or it could do load balancing as well. I think that would be a bit more challenging.
We haven't needed to contact Microsoft technical support. When we have trouble we usually use Google to search for what we need to find out. Also, in terms of issues, there's a lot of information on SQLServerCentral and Stack Overflow.
For the most part, we started with this solution.
The initial setup of this solution is pretty much straightforward.
If you want to develop with Visual Studio then you have to install the data service add-ons afterward, so it is a bit cumbersome. Then, if you want to use the catalog on the database, with deployment there are often security issues and you have to get an SQL catalog up and running. This can also be a bit cumbersome.
I would say that it takes a day or two to deploy this solution in a new environment, and it can be completed by one or two people. A single developer may be sufficient to deploy and maintain the system.
I implemented some of this myself and had help in terms of setting up the security. There are often security settings that require the assistance of a DBA.
This solution was already in place. That's what is available and it's what people know. Going forward, this will most likely change.
My advice to anybody implementing this solution is to look into whether to use it on a catalog in a database, versus using package deployment. There are pros and cons to both approaches in terms of deployment and security. I would say that's something that needs to be evaluated quite early. There are lots of benefits to the catalog, but also a bit more admin attached to it.
Another consideration is real-time processing needs. If this is a requirement then I would recommend against using this solution, unless the next version has a new set of features specifically for real-time processing.
I would rate this solution an eight out of ten.
For the full version of the SQL Server, SSIS, SSAS and SSRS will come as additional features for free. Hence, my organization need not spend extra money for other ETL, reporting and analysis tools. This can give very good flexibility.
In SSIS, the scope is not only to handle ETL challenges, but it will allow us to do so many other tasks, such as DBA activities, scripting, calling any .exe or scripts, etc.
SSIS can improve in handling different data sources like Salesforce connectivity, Oracle Cloud's connectivity, etc. Also, handling of the different data types will be a big challenge here; so expecting improvement in these areas.
There were no stability issues.
There were no scalability issues.
Technical support is very good.
Based on the client's requirements, we switched over to this solution.
The setup is straightforward.
We looked at Informatica and DataStage.
Don't worry, go ahead.
Thanks for the review and keep them coming.
I like what you put in here for improvements. However, don't hold your breath for Oracle Cloud integration. Most Oracle ETL/ELT tools don't have direct cloud integration yet and its not on the roadmap for a few years.
V/r,
Brian Dandeneau
CEO Applied Governance
Our primary use for this solution is to move data between points and applications.
This is a flexible tool to use and comes with the MSSQL server package.
This solution is easy to implement, has a wide variety of connectors, has support for Visual Basic, and supports the C language.
Tuning using this solution requires extensive expertise to improve performance.
This solution is included with the MSSQL server package.
During the last couple of years, I have integrated data with Dynamics Ax both with SSIS and BizTalk. A common question I'm asked is what is the difference when every thing is possible in SSIS why do we need BizTalk or what does BizTalk provide different from SSIS. So My answer to this question is something like:
Everything that BizTalk provides can be implemented in SSIS. But the major difference is batch processing. Usually SSIS package are used to migrate large set of data or dataset. BizTalk provide the operations to be perform on one message at time or real time processing. Because everything in BizTalk is XML so BizTalk is very slow on large set of data. BizTalk provides large number of adapters, while In SSIS you have to use direct connection by Oldb, or Sql db to communicate with different database and depend on OlDb connections. In BizTalk large number of Adapter provided to communicate which may or may not be depend on OlDB connection. Build in Tracking system (BAM) and its display on BAM portal is also big advantage on SSIS. For this purpose you have to make a custom tracking system in SSIS which require a lot of coding. Third advantage of BizTalk over SSIS is BRE. Business rule engine. BRE provide the condition whose value can be changed and complete follow of BizTalk application. These BRE roles can be used in multiple biztalk application while these functionality can be achieved on config files in SSIS.
In conclusion, when we required less data integration/migration and require complex decision making we used BizTalk. For example we have to implement complex work flow on single record. BizTalk application also used route data, read from one location, transform it and drop on other location. A simple example of this transactional data, when one transaction is occur in one system and its impact or integration will required on other system we will use BizTalk. BizTalk is a rapid development tool as compare to SSIS.
When we have a large sum of data, we require less complexity and requirement of integrated systems are based on Same technology then we have to use SSIS. Usually SSIS is used to migrate or integrate the non-transaction data or step up data. The delay of migration and integration possible or example Batch processing. SSIS is built for ETL process, it is not rapid integration tool.
But I think the cost is a big factor to go for biztalk or ssis
I am an ETL developer working as an information zone leader. We are an outsourcing company to our customers.
The most valuable feature of SSIS is that you can take data from other servers which are not MS SQL Server or Oracle.
I would like to see SSIS improve the collection of data trail servers and reporting. Future releases should improve the data lineage, as it currently is not good.
I have been using SQL Server Integration Services for five years.
This solution is stable, but the performance is not good. I believe it can be improved. Informatica is better.
I have not been restricted by this solution.
Prior to using SSIS I used Informatica. I switched because my organization is using SSIS.
The initial setup of this solution is not complex.
Most of the time we do the implementation in-house, however, we have used third parties in the past.
Our license with SSIS is annual.
If an organization has the money, I recommend they use Informatica.
I would rate SSIS a seven out of 10 overall.
We use the on-prem version of this solution. Our primary use case of this solution is for integrated data on the SQL server.
It has a drag and drop feature that makes it easy to use. It has a good user experience because it takes into account your most-used tools and they're lined up nicely so you can just drag and drop without looking too far. It also integrates nicely with Microsoft.
There are a lot of features that could make this solution better.
There were some issues when we tried to connect it to data storage. It was a connection issue. There is also room for improvement in the underlying language.
It is stable.
From personal experience, I really can't comment on the scalability, but from what I've seen online, and what I heard from other people is that it scales quite nicely.
I haven't had to contact technical support.
We previously used an in-house solution based on Oracle APEX.
The initial setup was straightforward.
We used a consultant for the integration.
We chose SSIS because it was a good financial decision. It was the most cost-effective option at the time.
There are many projects for the company that I work for that requires implementation for a client. I started with it because I just wanted to learn about it, and I had the chance to use it because there was an opportunity that opened up to implement it.
If you have data needs and you are a small or medium enterprise this is a good solution. If you are an organization and you're not dealing with terabytes of data, but you still need to analyze data to make that decision, you should go with this solution.
I would rate it a 7.5 out of ten.
MySql connectors do not need to be purchased. Just use ado.net connector and ODBC. That's been a part of SSIS for a decade. I've used it for Mysql before without any issues. This is all well documented and available from many forums.