ACS Commons Data Importer

[DeviB_]

Hi All,

We have around 1lakh assets for which we have to import the metadata properties of the assets, using out of the box metadata import we can import only 100 assets at a time, to overcome this we have access to data import tool under ACS AEM Commons on AEMaaCS. 

Please let me know the sample .xlsx file to be uploaded and above options to be filled while updating asset metadata properties, let us know if there is any limitations for number of assets metadata properties to be updated at once in a single .xlsx file

Thanks,

Devi

[EstebanBustamante]

Hi,

The format is specified on this page: https://adobe-consulting-services.github.io/acs-aem-commons/features/utils-and-apis/data-api/index.h.... If you need a reference or sample, you can use the sample file from here: https://adobe-consulting-services.github.io/acs-aem-tools/features/csv-asset-importer/index.html. You can download that sample and update it accordingly. The most important thing is to keep the "path" column, and then you can add all the other columns as metadata fields, following the instructions provided in the first link I shared.

As far as I know, there is no limitation on the quantity of metadata fields. However, you can simply check with one asset to make sure everything works fine before ingesting all your 1k assets

Hope this helps.

[DeviB_]

Hi @EstebanBustamante,

Thanks for your response.

I have tried by uploading the sample file you had mentioned, the file is getting uploaded but the metadata properties are not updating, PFA the same

Requesting you to update metadata property for at-least 1 asset as demo.

Thanks,

Devi

[EstebanBustamante]

The metadata is updated correctly on my end, see below:

I cannot share the file I used for the import due to .csv files being blocked by this editor, but here is its content:

absTargetPath,relSrcPath,dc:title {{ String : multi }},dc:description {{ String : multi }},cq:tags {{ String : multi }},migratedDate {{ Date }}, ../jcr:content/originalDocId {{ Long }},../jcr:content/fulfillment/canOrder {{ Boolean }},../jcr:content/fulfillment/inventoryCount {{ Int }}
/content/dam/demo/icon.png,images/icon.png,Ira the dog,Ira is the best dog in the whole wide world.,stockphotography:business/business_people|properties:orientation/portrait,2008-04-12T09:45:54.000+02:00,100264,TRUE,10

 
Hope this helps

[DeviB_]

Hi @EstebanBustamante,

I have tried on my end by providing the same data. But the metadata is not getting updated. As i'm using AEMaaCS here i don't see the CSV Asset Importer, so instead of that I have Data Importer.

Can you help me out in providing the right answers and choosing the correct option for the below

For Data Importer we would be using .xlsx file as .csv is not supported.

Happy Day

Thanks,

Devi

[diksha_mishra]

@DeviB_ you can't use the sample file in your AEM instance as those aren't real values mapped to your assets.

In column A, you need your own asset's path. For that, please select the folder containing the assets> click on 3 dots at top> Export Metadata. This will generate a CSV file with metadata info of your already uploaded assets. You can modify the same file, save it as .xlsx and import with your modifications.

Hope this helps.

[DeviS1]

Hi @diksha_mishra ,

I had uploaded images path which ever i had in my system, even though I'm not able to get the assets properties updated.

Thanks,

Devi

[narendragandhi]

Hi @DeviB_ 

Have these assets already been imported in AEM? The bulk import tool for assets also gives an option to upload the metadata for all those assets.

There is a custom script for bulk metadata update as well - https://github.com/leachuk/aem-asset-upload

If the ACS Commons options does not work you can try this script.

Thanks

Narendra

[DeviB_]

Hi @narendragandhi,

We already have the assets but only the metadata needs to be updated. Can you let me know regarding the bulk import tool for updating metadata of assets.

Thanks,

Devi

[Kamal_Kishor]

@DeviB_ : Are you selecting the appropriate options? Every option/radio field will make the importer behave in a certain way.

Please refer this (if not already seen): https://adobe-consulting-services.github.io/acs-aem-commons/features/mcp-tools/data-importer/index.h...

There are several options to control how data will be brought into AEM with this tool:

• Excel file: Provide the excel file. In Windows you must ensure the file is not currently open in Excel or you will receive an error.
• Existing action: Decide how data should be managed if the destination nodes alread exist or do not already exist yet.
• Structure node type: If intermediate nodes in the path are missing, this decides what type they should be.
• Dry run: Only report on what actions would be taken without doing any actual work.
• Detailed report: Report on all actions taken, otherwise only brief summary information is provided in the report.
• Import in sorted order: Ignores order in spreadsheet and sorts everything by path before processing.

[DeviS1]

Hi @Kamal_Kishor,

I have referred the document and tried using the information provided in that, but I need something which gives in detail information about each fields and a sample xlsx file.

Thanks.

Devi  

[PriyankaKu]

Hi @DeviB_ 

You can use OOTB Metadata Import tool to add metadata to all assets, this has batch limit of 100 which means from csv it will pick assets in batch of 100 until all asset is not updated. I have used this to update approx 70K assets and found no issue.

You can go through below link for preparation of csv to import:

https://experienceleague.adobe.com/en/docs/experience-manager-learn/assets/metadata/metadata-import-...

Thanks,

[DeviS1]

Hi @PriyankaKu ,

We have assets in lakhs so it would be time consuming for updating 100 assets in a batch, i there any other option for updating assets properties or can we update more than 100 assets in a batch.

Thanks,

Devi

[PriyankaKu]

I am able to update metadata using data importer tool using below excel data, you can also use in same way metadata_name@type

path	GTIN_NBR@string	ITEM_NBR@string	PROD_ID@string	ITEM_GRP_NM@string	ITEM_COLOR@string	ITEM_SIZE@string	BRAND_NM@string	CATG_ID@string	CATG_DISP_NM@string	ITEM_STATUS_CD@string
/content/dam/test-images/0072621412006_A.jpg	72621412006	307818	prod20301178	Hanes 6 Pack V-Neck Tees-Black/Grey Size XL	Black/Grey	XL	Hanes	2920103	Underwear & Sleepwear	A
/content/dam/test-images/0072621412006_B.jpg	72621412006	307818	prod20301178	Hanes 6 Pack V-Neck Tees-Black/Grey Size XL	Black/Grey	XL	Hanes	2920103	Underwear & Sleepwear	A
/content/dam/test-images/0072621412006_C.jpg	72621412006	307818	prod20301178	Hanes 6 Pack V-Neck Tees-Black/Grey Size XL	Black/Grey	XL	Hanes	2920103	Underwear & Sleepwear	A
/content/dam/test-images/0072621412006_Video.mp4	72621412006	307818	prod20301178	Hanes 6 Pack V-Neck Tees-Black/Grey Size XL	Black/Grey	XL	Hanes	2920103	Underwear & Sleepwear	A

[am_DAM_manager]

Devi,

I am having similar problem, almost the exact same reasons. The OOTB 100 asset max is just not feasible. I am trying to us the Data Importer for ASC and on AEM managed service 6.5

I have an accurate excel file per the directions and keep getting successful reports, no errors but yet the metadata is not actually updated in the asset properties.

Were you able to ever get yours working?

[kautuk_sahni]

@DeviB_Did you find the suggestions from users helpful? Please let us know if more information is required. Otherwise, please mark the answer as correct for posterity. If you have found out solution yourself, please share it with the community.