Robots.txt configuration in AEM

[Ratna_Kumar]

Hi,

I want to hide one page from our website in google and other search engines.

Pgae : /content/domain/abc.html

How to do configuration in AEM, Any one please send the configuration steps.

Br,

Ratna Kumar

[ompandeyy · Accepted solution]

You can disallow those pages ? Like this:

http://events.sap.com/robots.txt

also you can write logic to hide them while generating sitemap

[Ratna_Kumar]

Hi,

Yes i need to disallow the below page

www. abc.com/1234.html

Could you please elaborate on this.

Why need to create sitemap ?, my website don't have the site map.

Br,

Ratna Kumar