Migration

[bhavigoyal]

Hi,
I want to upload ~150tb of data to aem assets and manage them. Currently, my data is in another CRM. So, what are the options available to migrate ~150 TB data to AEM assets from another CRM?
@arunpatidar 

@kautuk_sahni 

[digarg · Accepted solution]

~150 TB is huge . You will not only need to migrate asset binary files bt also prepare metadata for the same.

1. First try to do some filtering if the entire data is relevant and needs to be migrated 
2. Check if migration can happen in batches of data and how you want to group them.
3. Migration approach depends on which CRM and also  wether destination is AEM AMS or cloud .
4. Migrating to common storage like s3 /azure and using a bulk importer is most popular approach.
5. Think through what metadata needs migration and how you will prepare metadata sheet.
6. AMS INSTANCE- https://adobe-consulting-services.github.io/acs-aem-commons/features/mcp-tools/asset-ingestion/index...
7. Cloud - https://experienceleague.adobe.com/en/docs/experience-manager-learn/cloud-service/migration/bulk-imp...

[arunpatidar]

Hi @bhavigoyal 
Check with someone who already did the migration with that large amount of data.

https://experienceleaguecommunities.adobe.com/t5/adobe-experience-manager/migrating-15tb-asset-to-ae... 

From my past experience, I have migrated only GBs of data and I used package manager and to create renditions used ACS Commons Bulk Assets workflow managaer.