Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

danatanseo
danatanseo
Offline

Badges

Badges
2

Accepted Solutions

Accepted Solutions
0

Likes Received

Likes Received
1

Posts

Posts
5

Discussions

Discussions
4

Questions

Questions
0

Ideas

Ideas
5

Blog Posts

Blog Posts
0
Top badges earned by danatanseo
Customize the badges you want to showcase on your profile
Re: Add capability for clients using a subdomain like analytics.yoursitename.com to disallow search engines from crawling - Adobe Analytics 19-07-2022
Also for clarification: We are not concerned that this activity is impacting our budget with Adobe. We are concerned that this activity is seriously impacting our Google crawl budget, which is finite. "Budget" in this sense is not monetary. Here is how Google defines crawl budget: https://developers.google.com/search/docs/advanced/crawling/large-site-managing-crawl-budget Historically, we have had Googlebot crawl analytics.underarmour.com so much that this activity nearly brought down our site s...

Views

100

Likes

0

Replies

0
Re: Add capability for clients using a subdomain like analytics.yoursitename.com to disallow search engines from crawling - Adobe Analytics 19-07-2022
@Jennifer_Dungan According to kohn@adobe.com: "The bot reports are for a different purpose, and they are setup for Under Armour (I reviewed them with Dian last week). The Bot reports cover the bots that are hitting www.underarmour.com, and identify which bots and which pages are being crawled. The reports are at: Reports>Site Metrics>Bots. The Admin access is needed to configure the bot reports, but they are already configured for Under Armour."This request I opened pertains to https://analytics...

Views

113

Likes

0

Replies

0
Re: Add capability for clients using a subdomain like analytics.yoursitename.com to disallow search engines from crawling - Adobe Analytics 19-07-2022
Thanks for the upvote Jennifer. Question: Adobe owns and manages this sub-domain, so we can't do anything at the server level. As a consequence, we also have zero access to bot reports. Even if we did, why would we ever want any bots to crawl this subdomain? It seems perhaps another course of action Adobe could take would be to do as you suggest and block bots to this subdomain at the server level.

Views

131

Likes

0

Replies

0
Add capability for clients using a subdomain like analytics.yoursitename.com to disallow search engines from crawling - Adobe Analytics 18-07-2022
Description - As a user, we would like Adobe to provide us access to the robots.txt file of our analytics subdomain so we can prevent search engines from crawlingWhy is this feature important to you - Googlebot is crawling resources on our adobe hosted analytics subdomain millions of times a week. This is hurting our crawl budget, resulting in less traffic and revenue to our eCommerce sitesHow would you like the feature to work - We would like the robots.txt set to Disallow allUser-agent: * Disa...

Views

145

Like

1

Replies

7
Likes from