There is no clear solution but 2 workarounds: Workaround 1:Only for dev and stage domains, we can use custom path for robots.txt, e.g. https://publish-pxxxx-exxxx.adobeaemcloud.com/my-path/robots.txt - which shows custom robots file.Workaround 2:Configure custom domain names for dev and stage envs ...