Allow Chatgpt Bot

[bjoern__koth]

Hi all,

does anyone know whether ChatGPT and other AI crawlers are currently already included in the IAB bot list?

We're currently having the IAB bot list feature enabled, and are capturing the user agent of incoming traffic, and as far as I can see there are not "openai" user agents captured

https://platform.openai.com/docs/bots/

Just wondering since our business stakeholders would be interested in getting the bot crawler traffic through, and the WAF is already opened up to let that kind of traffic through.

Is there actually a way to unblock a certain browser in the Bot rules that may be included in the bot list?

[FarazHusain]

Hey @bjoern__koth As of now, there is no public information confirming that OpenAI's crawlers, such as GPTBot or OAI-SearchBot, are included in the IAB/ABC list, so difficult to comment. 

Regarding unblocking, I doubt that's possible using bot rules, not sure if VISTA could help here. 

[bjoern__koth]

Hmm ok, so a bit of a black box. Fair enough, I cannot see any user agent containing "openai", also no Bot Name over the past 90 days.

So, maybe it's already on the IAB list

[Jennifer_Dungan]

I also am not sure about whether the IAB included AI Bots... but I am pretty sure that there is no "bot whitelist".

That said, how deep do you need the bot information? Workspace does have some limited data from Bots, including the Bot Name and the Page that the Bot hit...

So, you should be able to get a simple report without opening up traffic collection to those bots....