Bullk edit crawlability of pdf's in AEM

[aaa09002]

Hi

Is there a way to bulk edit a few hundreds of pdfs - we want search engine bots not to crawl them but still searchable in internal search. But instead of doing it manually, is there a way we can bulk edit them in cUrl or any other easy way?

Thanks

[Sachin_Arora_ · Accepted solution]

You can use Assets API if you want to update metadata using server scripts. Sample Command to update title.

Request: PUT /api/assets/myfolder/myAsset.png -H"Content-Type: application/json" -d '{"class":"asset", "properties":{"jcr:title":"My Asset"}}'

Link : https://experienceleague.adobe.com/docs/experience-manager-65/assets/extending/mac-api-assets.html?l...

You can also use CSV file to do update of Asset metadata using Metadata Import in AEM.
https://experienceleague.adobe.com/docs/experience-manager-65/assets/using/metadata.html?lang=en#imp...

Please disable launchers/processing profiles while running scripts to avoid changing of lastModified property of asset and overload on AEM.

[HeenaMadan]

You can do bulk updates of Asset metadata using a CSV file. Refer https://experienceleague.adobe.com/docs/experience-manager-65/assets/using/metadata.html?lang=en#imp...

To prevent your PDF file from being listed in search results, use the HTTP X-Robots-Tag response header, e.g.:

X-Robots-Tag: noindex

OR 

rel="nofollow" on links to those PDFs

<a href="mypdf.pdf" rel="nofollow">Download PDF</a>

Refer https://developers.google.com/search/docs/advanced/robots/robots_meta_tag