Filter out Spider and Bot traffic from SiteCatalyst

Avatar

Avatar

vabeachkevin1

Avatar

vabeachkevin1

vabeachkevin1

11-02-2010

There should be an option to filter out all spider and bot traffic from SiteCatalyst reports, very similar to what was available from the HBX User Agent Filtering option. 

19 Comments (19 New)
19 Comments

Avatar

Avatar

BretGundy

Employee

Avatar

BretGundy

Employee

BretGundy
Employee

08-04-2010

Excellent comments here. While bot traffic is currently a small percentage, we're looking into some ideas now, as more bots and spiders are starting to execute JavaScript and request images.

Avatar

Avatar

benjamingaines2

Avatar

benjamingaines2

benjamingaines2

22-11-2010

Marking this "In Progress," per Bret Gundersen.

Avatar

Avatar

miikka

Avatar

miikka

miikka

08-12-2010

This is very good idea, not least regarding the Google Preview "spider" bloating traffic. I'd like to see this option also in Data Warehouse.

Avatar

Avatar

jamest0

Avatar

jamest0

jamest0

18-07-2011

Any update on this growing issue?

Avatar

Avatar

BretGundy

Employee

Avatar

BretGundy

Employee

BretGundy
Employee

27-07-2011

We are making progress on bot filtering, but I can't provide a timeline at this point. 

Avatar

Avatar

cisco_webteam

Avatar

cisco_webteam

cisco_webteam

10-10-2011

Yeah, i can't believe what's available in HBX is not available even in SC 15

Avatar

Avatar

jdnyland

Avatar

jdnyland

jdnyland

03-11-2011

The bot handling reporting is looking really good.  Let me know if you would like to try it out in the beta environment.

Avatar

Avatar

jane_mason

Avatar

jane_mason

jane_mason

16-12-2011

We have a very large amount of MSN bot traffic in our data - an MSN bot that executes java script. We had the same problem with Google preview bot last Nov.

 

Omniture needs to prevent bots that execute java script from getting in our data and more importantly we are PAYING for the server calls. How about refund???????? (lol)

Avatar

Avatar

jdnyland

Avatar

jdnyland

jdnyland

26-04-2012

This one is now implemented.  You can turn it on in the admin console and enable the IAB bot list with a single click.  Custom bot rules can also be created for user agents or IP addresses.