Traffic a A/B split test not splitting as set | Community
Skip to main content
maureenb1015
maureenb1015
Level 2
August 16, 2018

Traffic a A/B split test not splitting as set

  • August 16, 2018
  • 2 replies
  • 8832 views

I've set up an A/B split test routing traffic 50/50 to a redirect page. But after activating the test and letting it run for a few days reporting shows the split of 93/7. Why is it not splitting as set?

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

    2 replies

    P
    Adobe Employee
    PranavKaushik1789Adobe Employee
    Adobe Employee
    August 17, 2018

    Hi Maureen,

    I suspect that you might have activated,deactivated and reactivated test before letting it remain live for some time and also the case might be that you have changed the split in between.

    These were usually the reasons behind this skewedness.

    Could you please confirm.

      maureenb1015
      maureenb1015Author
      Level 2
      August 17, 2018

      pranavkaushik​ - thanks for responding. For this experiment I did not activate, deactivate and reactivate. Only activated it once and its been running since. Any other ideas?

        P
        Adobe Employee
        PranavKaushik1789Adobe Employee
        Adobe Employee
        August 17, 2018

        Hi ,

        Also what about the change in split distribution in between i.e. after the test has been made live did you change the traffic split??

          LJ_Jones
          LJ_Jones
          Level 3
          August 17, 2018

          A couple of thoughts.

          1. How much traffic are you talking about here?  Can you give us some actual numbers?  Sometimes with small volumes of traffic the split takes a bit of time to even out, even though it shouldn't.
          2. Do you have any other audience segments set up?  Sometimes audience segments can cause strange splits.
            maureenb1015
            maureenb1015Author
            Level 2
            August 17, 2018

            @LJ Jones - over 12k uniques have been through the experiment so that's not the issues. And no other audience segments are set up so no one should be suppressed from either cell.

            I am getting A4T will only work with redirect offers with at.js v.0.9.6 or newer and visitorAPI.js v2.1.0 or newer. Learn more. warning but I would assume if this was an issue no one would have gotten into the test cell.

              LJ_Jones
              LJ_Jones
              Level 3
              August 17, 2018

              We probably should have started with reporting.  Where are you looking at reporting?  In A4T(Analytics) or in Target?  The error you are getting is telling you that its a reporting error and not a splitting traffic error.  So people can still get into the experience, but it will report wrong in A4T if you are on an older version of at.js.  Do you know what version you are on?  And have you checked to see what Target is reporting?

                Terms & ConditionsAccessibility statement

                Loading footer...