Cloud based Data integration Service.
Can be think as SSIS on cloud.
- Better automation power like In build scheduling mechanism (Json based).
- Fault Tolerant Pipeline execution, we can Re tries for Transient failure.
- Monitoring and Alerts.
- Staging feature for intermediate processing.
Monitoring: To Do add screenshots
In build copy activity- Blob to SQL.
Need Data manger – To copy from legacy systems.
Custom .Net activity – Need to add new Azure Batch account for compute.
To Write Custom .Net activity code we have to install the Data Factory VS Extension. Installation path from Visual Studio VS -> Tools-> Extension and Updates.
Afterward we can use the Data Factory Templates.
From VS we can also publish the Data Factory project into cloud with all dependencies (package/dlls).