Bot exclusion based on behavior analysis

Avatar

Avatar

sdkoenig

Avatar

sdkoenig

sdkoenig

30-08-2012

Sitecatalyst should offer an option to exclude bots based on behavior. We are in constant competition with our competitors to crawl information from other parties. Therefor the bots are sadly not as friendly as to keep the User-Agent-String constant to use the same IP. 

 

I don't know what the best logic would be for recognizing bots based on the data Adobe has, but as a very first step it would be helpfull to set a threshold after which a client is excluded (same UA and IP (probably with range)).

 

As a further step it would be nice to have a scoring for a bot probability per visit from Adobe and an option to set a score when a visit is excluded.

1 Comment (1 New)
1 Comment

Avatar

Avatar

benjamingaines2

Avatar

benjamingaines2

benjamingaines2

31-08-2012

Great suggestion, Sebastian. I know this is something we had talked about internally here some time ago.