Bot exclusion based on behavior analysis | Community
Skip to main content
Level 3
August 31, 2012
New

Bot exclusion based on behavior analysis

  • August 31, 2012
  • 1 reply
  • 997 views

Sitecatalyst should offer an option to exclude bots based on behavior. We are in constant competition with our competitors to crawl information from other parties. Therefor the bots are sadly not as friendly as to keep the User-Agent-String constant to use the same IP. 

 

I don't know what the best logic would be for recognizing bots based on the data Adobe has, but as a very first step it would be helpfull to set a threshold after which a client is excluded (same UA and IP (probably with range)).

 

As a further step it would be nice to have a scoring for a bot probability per visit from Adobe and an option to set a score when a visit is excluded.

1 reply

benjamingaines2
Adobe Employee
Adobe Employee
August 31, 2012

Great suggestion, Sebastian. I know this is something we had talked about internally here some time ago.