Expand my Community achievements bar.

Don’t miss the AEM Skill Exchange in SF on Nov 14—hear from industry leaders, learn best practices, and enhance your AEM strategy with practical tips.
SOLVED

Hiding prod.adobemsbasic.com from search engines

Avatar

Level 2

Hi,

 

Noticed that our sites main URL and actual server url "XXXX-prod.adobemsbasic.com" is being served to search engines. Wanted to ask here and see if anyone else has had the same issue and what they have tried to resolve it.

 

Thanks,

Paul.

1 Accepted Solution

Avatar

Correct answer by
Community Advisor

Hi,

 

You can create robots.txt if not already present and disallow all web crawlers from indexing the staging or production URLs.

 

Contents of robots.txt can be
User-agent: * Disallow: /

 

View solution in original post

1 Reply

Avatar

Correct answer by
Community Advisor

Hi,

 

You can create robots.txt if not already present and disallow all web crawlers from indexing the staging or production URLs.

 

Contents of robots.txt can be
User-agent: * Disallow: /