Expand my Community achievements bar.

SOLVED

Migration

Avatar

Level 4

Hi,
I want to upload ~150tb of data to aem assets and manage them. Currently, my data is in another CRM. So, what are the options available to migrate ~150 TB data to AEM assets from another CRM?
@arunpatidar 

@kautuk_sahni 

Topics

Topics help categorize Community content and increase your ability to discover relevant content.

1 Accepted Solution

Avatar

Correct answer by
Employee

~150 TB is huge . You will not only need to migrate asset binary files bt also prepare metadata for the same.

  1. First try to do some filtering if the entire data is relevant and needs to be migrated 
  2. Check if migration can happen in batches of data and how you want to group them.
  3. Migration approach depends on which CRM and also  wether destination is AEM AMS or cloud .
  4. Migrating to common storage like s3 /azure and using a bulk importer is most popular approach.
  5. Think through what metadata needs migration and how you will prepare metadata sheet.
  6. AMS INSTANCE- https://adobe-consulting-services.github.io/acs-aem-commons/features/mcp-tools/asset-ingestion/index...
  7. Cloud - https://experienceleague.adobe.com/en/docs/experience-manager-learn/cloud-service/migration/bulk-imp...

 

View solution in original post

2 Replies

Avatar

Correct answer by
Employee

~150 TB is huge . You will not only need to migrate asset binary files bt also prepare metadata for the same.

  1. First try to do some filtering if the entire data is relevant and needs to be migrated 
  2. Check if migration can happen in batches of data and how you want to group them.
  3. Migration approach depends on which CRM and also  wether destination is AEM AMS or cloud .
  4. Migrating to common storage like s3 /azure and using a bulk importer is most popular approach.
  5. Think through what metadata needs migration and how you will prepare metadata sheet.
  6. AMS INSTANCE- https://adobe-consulting-services.github.io/acs-aem-commons/features/mcp-tools/asset-ingestion/index...
  7. Cloud - https://experienceleague.adobe.com/en/docs/experience-manager-learn/cloud-service/migration/bulk-imp...

 

Avatar

Community Advisor

Hi @bhavigoyal 
Check with someone who already did the migration with that large amount of data.

https://experienceleaguecommunities.adobe.com/t5/adobe-experience-manager/migrating-15tb-asset-to-ae... 

 

From my past experience, I have migrated only GBs of data and I used package manager and to create renditions used ACS Commons Bulk Assets workflow managaer.



Arun Patidar