Possible bot traffic Sept 2024 | Community
Skip to main content
Level 2
September 17, 2024
Question

Possible bot traffic Sept 2024

  • September 17, 2024
  • 3 replies
  • 1807 views

Is anyone else seeing a jump in visits from a possible bot? In one week, we jumped from 2 million to 3 million visits, which is unusual outside of November.

These million visits have no referring domain, multiple user agents, multiple IP addresses, no corresponding orders and most of them bounce after the first page. Almost all are mobile devices but not a specific browser, device, or operating system. It's not tied to a specific geo-location.

 

We know it's bogus, but we can't block it in our usual ways.

 

Does anyone have any other ideas of how to identify and block this traffic?

3 replies

bjoern__koth
Community Advisor and Adobe Champion
Community Advisor and Adobe Champion
September 18, 2024

Sounds like a crawler indeed.

 

And the user agent string does not contain anything identifying the crawler's name?

If you look at browser versions, do they seem old? Sometimes it's worthwhile checking when specific browser versions were released e.g., everthing < Chrome version 100 can for sure be considered a bot.

Also, do you see this traffic coming from one specific Operating System like Linux?

Cheers from Switzerland!
toddc2546979
September 24, 2024

This traffic is all coming in on old Chrome Mobile browsers. The question is, why is it not being filtered out from the Adobe reporting? 

bjoern__koth
Community Advisor and Adobe Champion
Community Advisor and Adobe Champion
September 24, 2024

Well, because old browsers are not necessarily automatically landing on bot lists just because they are old.

 

But if you know it's the same browser, you can at least act on them

 

https://experienceleague.adobe.com/en/docs/analytics/admin/admin-tools/manage-report-suites/edit-report-suite/report-suite-general/bot-removal/bot-rules

Cheers from Switzerland!
Krishna_Musku
Community Advisor
Community Advisor
September 18, 2024

Agree with @bjoern__koth

@ctro Also, do you have Bot Rules enabled for your report suite? These are default to IAB rules. But you can add custom rules specific to your needs.

ctroAuthor
Level 2
September 18, 2024

Yes, we have that enabled and we have added a few user agents and IP addresses to the exclusion list.

Thanks!

Amruthesh_AG
Community Advisor
Community Advisor
October 1, 2024

We also faced same issue and then raised a case with adobe to know the IP address.

Adobe has provided the IP address. Based on IP range i have updated IAB bot rule.

After that I never faced this issue.

Meghan_Powers
Community Advisor and Adobe Champion
Community Advisor and Adobe Champion
October 29, 2024

We are also facing this problem and have identified the vast majority of the traffic in these criteria:

  • Mobile device = 
    • Google Pixel 2 9G011A)
      • or
    • Sprint Galaxy S5 (SM-G900P)
      • or
    • Google Nexus 5 (D820)
  • OR Mobile Device = Apple iPhone WITH operating system = iOS 11.0


We also tacked onto the segment AND last touch channel = direct OR Internal URL's but that may be unique to our setup.

For now, we've put an annotation in adobe analytics to use that segment we set up (and we set up an include and exclude segment).

@amruthesh_ag , what did you include in your request to adobe to send the IP's?

Amruthesh_AG
Community Advisor
Community Advisor
October 29, 2024

@meghan_powers  I have found out the bot traffic root cause(non business region with specific date range) and raised a support ticket with adobe to provide the IP address along with date range and browser details.

Adobe has checked in there data warehouse provide the details in excel format