Expand my Community achievements bar.

Join us for the next Community Q&A Coffee Break on Tuesday April 23, 2024 with Eric Matisoff, Principal Evangelist, Analytics & Data Science, who will join us to discuss all the big news and announcements from Summit 2024!

Easy way to filter traffic from Cloud Services (AWS/Azure etc)


Level 1


We have a significant volume of automated traffic hitting our site from AWS instances (likely crawlers). We've looked in the raw logs for something to identify this traffic, but there it comes from a wide range of IP addresses, sometimes showing the ISP domain as amazonaws.com, mostly from their Virginia data centre and doesn't give a helpful user agent.


To filter this out we'd need to create a complex IP filter rule and update it each time AWS acquire new IP addresses. Given that this is a common rule that many clients will require, and given the rapid growth of cloud compute services, it would make sense for Adobe to offer and maintain a bot rule to exclude AWS/Azure/rackspace etc.