Expand my Community achievements bar.

Filter out Spider and Bot traffic from SiteCatalyst

Avatar

Level 10

2/11/10

There should be an option to filter out all spider and bot traffic from SiteCatalyst reports, very similar to what was available from the HBX User Agent Filtering option. 

20 Comments

Avatar

Employee

4/8/10

Excellent comments here. While bot traffic is currently a small percentage, we're looking into some ideas now, as more bots and spiders are starting to execute JavaScript and request images.

Avatar

Level 1

12/8/10

This is very good idea, not least regarding the Google Preview "spider" bloating traffic. I'd like to see this option also in Data Warehouse.

Avatar

Level 1

11/3/11

The bot handling reporting is looking really good.  Let me know if you would like to try it out in the beta environment.

Avatar

Level 4

12/16/11

We have a very large amount of MSN bot traffic in our data - an MSN bot that executes java script. We had the same problem with Google preview bot last Nov.

 

Omniture needs to prevent bots that execute java script from getting in our data and more importantly we are PAYING for the server calls. How about refund???????? (lol)

Avatar

Level 1

4/26/12

This one is now implemented.  You can turn it on in the admin console and enable the IAB bot list with a single click.  Custom bot rules can also be created for user agents or IP addresses.