Adobe Target - 50/50 traffic split - test two experience vs their own controls

Avatar

Avatar

ryanj16539978

Avatar

ryanj16539978

ryanj16539978

25-07-2018

My team is stuck on this being an A/B test rather than if the control performs better than a customized experience. My original plan was to send 50% of the traffic to the control and 25% to Exp B and 25% to Exp C. The results of B and C would be combined because the primary goal of the test is to justify further testing in personalization/targeting. Is there a better way to look at this? I had found some documentation within Adobes resources but I can't find it to save my life now.

Thanks

View Entire Topic

Avatar

Avatar

LJ_Jones

Avatar

LJ_Jones

LJ_Jones

30-07-2018

You basically have two options to set this up.

1.  You can set this up using the visual experience composer.  It will be structured a little different than what you are describing.  Basically you will have two experiences with two audiences.  Since its a test, Target wants to test each experience against the same audience.  So its not possible to set it up as an experience with an audience vs a different experience with a different audience.  It wouldn't be a fair apples to apples comparison.  It would look like this.

Control:

  • Local Audience
  • Tourist Audience

Exp B

  • Local Audience
  • Tourist Audience

Here is a screen of how you get to setting up multiple audiences.

1538482_pastedImage_5.png

2.  The other option, is to set up three different tests.  So three tests each with one experience and one audience.  The problem here is that Target won't be able to compare the conversion rates for you.  You would have to do the comparison yourself using a spreadsheet, which I often do anyway.

Does this make sense?