LLM txt file is not accessible by gemini or any gpt

Hi Team,

Could you please provide your guidance on the following?

We recently created an llms.txt file under DAM with some content in it. This file is accessible via the domain (for example: https://www.mycompany.com/llms.txt). URL shortening is being handled through the dispatcher, and the file loads successfully in the browser without any issues.

However, when we try to access the same URL through Gemini or any gpt and request it to read the content, it returns an error stating that the file is not accessible or not available on the domain.

Since we have Microsoft CDN and AMS WAF rules in place, could you please advise whether we need to validate this at the CDN layer, AMS App Gateway WAF rules, or the dispatcher level?

Thanks in Advance

Regrads

Veera