CI/CD Setup for Adobe Experience Platform

[MasterLeeman]

Hi Team,

  We are using Adobe Experience Platform for maintaining ETL system. We are planning to integrate CI/CD pipeline from Azure DevOps to automate our changes. Could, you please is there any option to perform that.

[ChetanyaJain]

Hi @MasterLeeman ,

What are the specific tasks that you intend to perform on AEP? eg: Add/Update schema from one env to other.

This is not possible currently OOB, but AEP is all API driven, implying that scripts can be created easily and plugged into any DevOps process.

Please share the actions that you intend to perform, and we can guide you appropriately.

Thanks,

Chetanya Jain

[MasterLeeman]

@ChetanyaJain - Thanks for the update, in-case if i want to move the dataset from dev to test environment, then how should i achieve that using DevOps with the help of API. Could you please guide me on that.

[ChetanyaJain · Accepted solution]

@MasterLeeman,

• For the dataset -> the only thing recommended is creating/updating [1][2]. Since we do not move datasets along with the data. To move data, you need to configure the source connections and ingest it appropriate source.
• Moving schemas from one env to other will be more important. To do that, you will need to call these APIs.
  • export/import - [3]
  • read/update - [4]

Note: you will need to add the intelligence in the script to know the current status of the schema in the appropriate env and then call the relevant APIs.

[1] https://developer.adobe.com/experience-platform-apis/references/catalog/#tag/Datasets/operation/crea...

[2] https://developer.adobe.com/experience-platform-apis/references/catalog/#tag/Datasets/operation/putD...

[3] https://developer.adobe.com/experience-platform-apis/references/schema-registry/#tag/ExportImport/op...

[4] https://developer.adobe.com/experience-platform-apis/references/schema-registry/#operation/listLastB... 

I hope this helps!

Thanks,

Chetanya Jain

[MasterLeeman]

@ChetanyaJain  - thanks for the update, and one last thing like if i want to move the dataflow from one env to another shall i use the same api or any specific list is there. If so, kindly share that details as well.

Thanks,

Appreciate Your Help!!!

[ChetanyaJain]

@MasterLeeman, API calls will change depending on the state of the source and target system.

eg, If the object doesn't exist, you can utilize import for the schema. If an object exists, then the import will fail, and you may fire an update call.

If you have 10 things in development, and you want to move only one change, then you may selectively do using PUT calls.

Think of the strategy that works best in your scenario and define it.

[MasterLeeman]

Thanks for update, one final question like is there way to connect the DataLakeStorage of AEP. If so, kindly let me know how to navigate as well.

Thanks, 

Leeman

[MasterLeeman]

@ChetanyaJain Thanks for update, one final question like is there way to connect the DataLakeStorage of AEP. If so, kindly let me know how to navigate as well.