Bot Traffic Through Raw Full URL | Community
Skip to main content
skatofiabah
skatofiabah
Level 5
October 23, 2024
Question

Bot Traffic Through Raw Full URL

  • October 23, 2024
  • 2 replies
  • 2153 views

Hi All,

 

We have a system where we look at the Raw Full URL of the page, then the Operating System, then the IP Address in Adobe Analytics to identify bot traffic. We are getting a full URL with "?test=1" in the query string parameter that seems to be bot traffic. Are there other ways or query strings in the full raw URL that would indicate Bot Traffic too?

 

Thanks!

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

2 replies

PratheepArunRaj
Community Advisor and Adobe Champion
PratheepArunRajCommunity Advisor and Adobe Champion
Community Advisor and Adobe Champion
October 23, 2024

Dear @skatofiabah ,

'?test=1' need not be a bot ideally; rather, somebody is testing the page load in production (it might be your QC team) or trying to clear Akamai cache (usually, we use the query string parameter). 

Pretty not sure that using query string parameter is a reliable method to identify BOT.

Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

Thank You, Pratheep Arun Raj B (Arun) | Xerago | Terryn Winter Analytics
    V
    Vernon_H
    Level 2
    October 24, 2024

    Hi @skatofiabah,

     

    Agreed that the query string parameter would not be indicative of a bot. Personally, what we use is a mixture of User Agent, IP address, Countries, Click behavioural data, Timestamp and page views events to help identify the larger bots. I would also check the IAB filter to ensure that it is turned on (though it doesn't capture new/smaller bots).

    Cheers,

    Vernon

      skatofiabah
      skatofiabahAuthor
      Level 5
      October 24, 2024

      Hi @vernon_h,

      What is User Agent? I don't see that dimension in Adobe. Are there any other ways to slice besides those dimensions above?

      V
      Vernon_H
      Level 2
      October 30, 2024

      Headless Chrome means that the Chrome rendering engine is used, but all the "Chrome Controls" (such as the menu, previous and next buttons, URL bar, etc) are all hidden. Basically, just the webpage content is shown, but none of the standard user controls.

       

      While this can be common for bots, there are many reasons why general users would see this view as well.. it's not really a "silver bullet" of bot detection.


      Hi @jennifer_dungan,

       

      Interesting point in regards to the "bookmarks" on mobile phones - something I'll want to look into!

       

      100% not a sliver bullet, it has to be paired with other behavioural metrics. In our organisation's context, we do not expect a normal user to access the site via headless chrome and from the behavioural data is pretty obvious it's not a human. 

       

      The above was some suggested indicators to look out for. 

       

      Cheers,

      Vernon

        Terms & ConditionsAccessibility statement

        Loading footer...