Expand my Community achievements bar.

Bot exclusion based on behavior analysis

Avatar

Level 4

8/30/12

Sitecatalyst should offer an option to exclude bots based on behavior. We are in constant competition with our competitors to crawl information from other parties. Therefor the bots are sadly not as friendly as to keep the User-Agent-String constant to use the same IP. 

 

I don't know what the best logic would be for recognizing bots based on the data Adobe has, but as a very first step it would be helpfull to set a threshold after which a client is excluded (same UA and IP (probably with range)).

 

As a further step it would be nice to have a scoring for a bot probability per visit from Adobe and an option to set a score when a visit is excluded.

1 Comment