Expand my Community achievements bar.

ACS Commons Data Importer

Avatar

Level 2

Hi All,

 

We have around 1lakh assets for which we have to import the metadata properties of the assets, using out of the box metadata import we can import only 100 assets at a time, to overcome this we have access to data import tool under ACS AEM Commons on AEMaaCS. 

 

Screenshot 2024-03-11 at 6.49.56 PM.png

 

Please let me know the sample .xlsx file to be uploaded and above options to be filled while updating asset metadata properties, let us know if there is any limitations for number of assets metadata properties to be updated at once in a single .xlsx file

 

Thanks,

Devi

15 Replies

Avatar

Community Advisor

Hi,

 

The format is specified on this page: https://adobe-consulting-services.github.io/acs-aem-commons/features/utils-and-apis/data-api/index.h.... If you need a reference or sample, you can use the sample file from here: https://adobe-consulting-services.github.io/acs-aem-tools/features/csv-asset-importer/index.html. You can download that sample and update it accordingly. The most important thing is to keep the "path" column, and then you can add all the other columns as metadata fields, following the instructions provided in the first link I shared.

 

As far as I know, there is no limitation on the quantity of metadata fields. However, you can simply check with one asset to make sure everything works fine before ingesting all your 1k assets

 

Hope this helps.

 



Esteban Bustamante

Avatar

Level 2

Hi @EstebanBustamante,

 

Thanks for your response.

I have tried by uploading the sample file you had mentioned, the file is getting uploaded but the metadata properties are not updating, PFA the same

Screenshot 2024-03-12 at 12.32.45 PM.png

 

Requesting you to update metadata property for at-least 1 asset as demo.

 

Thanks,

Devi

 

Avatar

Community Advisor

The metadata is updated correctly on my end, see below:

EstebanBustamante_0-1710250916312.png

I cannot share the file I used for the import due to .csv files being blocked by this editor, but here is its content:

absTargetPath,relSrcPath,dc:title {{ String : multi }},dc:description {{ String : multi }},cq:tags {{ String : multi }},migratedDate {{ Date }}, ../jcr:content/originalDocId {{ Long }},../jcr:content/fulfillment/canOrder {{ Boolean }},../jcr:content/fulfillment/inventoryCount {{ Int }}
/content/dam/demo/icon.png,images/icon.png,Ira the dog,Ira is the best dog in the whole wide world.,stockphotography:business/business_people|properties:orientation/portrait,2008-04-12T09:45:54.000+02:00,100264,TRUE,10

 
Hope this helps



Esteban Bustamante

Avatar

Level 2

Hi @EstebanBustamante,

 

I have tried on my end by providing the same data. But the metadata is not getting updated. As i'm using AEMaaCS here i don't see the CSV Asset Importer, so instead of that I have Data Importer.

Can you help me out in providing the right answers and choosing the correct option for the below

Screenshot 2024-03-12 at 9.11.52 PM.png

For Data Importer we would be using .xlsx file as .csv is not supported.

 

Happy Day

Thanks,

Devi

Avatar

Community Advisor

@DeviB_ you can't use the sample file in your AEM instance as those aren't real values mapped to your assets.

In column A, you need your own asset's path. For that, please select the folder containing the assets> click on 3 dots at top> Export Metadata. This will generate a CSV file with metadata info of your already uploaded assets. You can modify the same file, save it as .xlsx and import with your modifications.

Hope this helps.

 

Avatar

Level 2

Hi @diksha_mishra ,

 

I had uploaded images path which ever i had in my system, even though I'm not able to get the assets properties updated.

 

Thanks,

Devi

Avatar

Community Advisor

Hi @DeviB_ 

 

Have these assets already been imported in AEM? The bulk import tool for assets also gives an option to upload the metadata for all those assets.

 

There is a custom script for bulk metadata update as well - https://github.com/leachuk/aem-asset-upload

If the ACS Commons options does not work you can try this script.

 

Thanks

Narendra

Avatar

Level 2

Hi @narendragandhi,

 

We already have the assets but only the metadata needs to be updated. Can you let me know regarding the bulk import tool for updating metadata of assets.

 

Thanks,

Devi

Avatar

Community Advisor

@DeviB_ : Are you selecting the appropriate options? Every option/radio field will make the importer behave in a certain way.

Please refer this (if not already seen): https://adobe-consulting-services.github.io/acs-aem-commons/features/mcp-tools/data-importer/index.h...

There are several options to control how data will be brought into AEM with this tool:

  • Excel file: Provide the excel file. In Windows you must ensure the file is not currently open in Excel or you will receive an error.
  • Existing action: Decide how data should be managed if the destination nodes alread exist or do not already exist yet.
  • Structure node type: If intermediate nodes in the path are missing, this decides what type they should be.
  • Dry run: Only report on what actions would be taken without doing any actual work.
  • Detailed report: Report on all actions taken, otherwise only brief summary information is provided in the report.
  • Import in sorted order: Ignores order in spreadsheet and sorts everything by path before processing.

Avatar

Level 2

Hi @Kamal_Kishor,

 

I have referred the document and tried using the information provided in that, but I need something which gives in detail information about each fields and a sample xlsx file.

 

Thanks.

Devi  

Avatar

Employee

Hi @DeviB_ 

 

You can use OOTB Metadata Import tool to add metadata to all assets, this has batch limit of 100 which means from csv it will pick assets in batch of 100 until all asset is not updated. I have used this to update approx 70K assets and found no issue.

PriyankaKu_0-1710828451554.png

You can go through below link for preparation of csv to import:

https://experienceleague.adobe.com/en/docs/experience-manager-learn/assets/metadata/metadata-import-...

 

Thanks,

Avatar

Level 2

Hi @PriyankaKu ,

 

We have assets in lakhs so it would be time consuming for updating 100 assets in a batch, i there any other option for updating assets properties or can we update more than 100 assets in a batch.

 

Thanks,

Devi

Avatar

Employee

I am able to update metadata using data importer tool using below excel data, you can also use in same way metadata_name@type

pathGTIN_NBR@stringITEM_NBR@stringPROD_ID@stringITEM_GRP_NM@stringITEM_COLOR@stringITEM_SIZE@stringBRAND_NM@stringCATG_ID@stringCATG_DISP_NM@stringITEM_STATUS_CD@string
/content/dam/test-images/0072621412006_A.jpg72621412006307818prod20301178Hanes 6 Pack V-Neck Tees-Black/Grey Size XLBlack/GreyXLHanes2920103Underwear & SleepwearA
/content/dam/test-images/0072621412006_B.jpg72621412006307818prod20301178Hanes 6 Pack V-Neck Tees-Black/Grey Size XLBlack/GreyXLHanes2920103Underwear & SleepwearA
/content/dam/test-images/0072621412006_C.jpg72621412006307818prod20301178Hanes 6 Pack V-Neck Tees-Black/Grey Size XLBlack/GreyXLHanes2920103Underwear & SleepwearA
/content/dam/test-images/0072621412006_Video.mp472621412006307818prod20301178Hanes 6 Pack V-Neck Tees-Black/Grey Size XLBlack/GreyXLHanes2920103Underwear & SleepwearA

Avatar

Level 1

Devi,

 

I am having similar problem, almost the exact same reasons. The OOTB 100 asset max is just not feasible. I am trying to us the Data Importer for ASC and on AEM managed service 6.5

 

I have an accurate excel file per the directions and keep getting successful reports, no errors but yet the metadata is not actually updated in the asset properties.

 

Were you able to ever get yours working?

Avatar

Administrator

@DeviB_Did you find the suggestions from users helpful? Please let us know if more information is required. Otherwise, please mark the answer as correct for posterity. If you have found out solution yourself, please share it with the community.



Kautuk Sahni