Azure DevOps CI-CD pipeline for Azure Data Factory

Question

I have created a CI-CD pipeline to deploy pipelines from my development data factory to the production data factory and it works perfectly for the first run. However, when a change is made in the dev, for example,

renamed pipeline1 to pipeline001

the production data factory has a pipeline by the name pipeline001 and also pipeline1, both of which are the same. The issues persist for any kind of change and are not just restricted to renaming. I checked the JSON templates, which was found ok. Any help?

Answer 1

Are you deploying with ARM templates? Depending on the types of changes, the Incremental deployment mode will add to your existing resources. After the release pipeline runs and all resources inside the resource group that isn't included in the ARM per the documentation will be deleted. Check if you are including all of the Data Factory resources in your ARM template. In other words, are the things you're missing in the Data Factory included in the ARM. That's the only possible cause for this problem.