Skip to main content
OI_MEI_Lee
OI_MEI_Lee
Level 2
October 26, 2016
Question

A/B Testing - results

  • October 26, 2016
  • 1 reply
  • 1187 views

I'm working on a subject line A/B testing and decide to select Opens as the winning criteria but wondering what if the results end up 50/50, how do we define the winning email then?

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

1 reply

Jessica_Kao3
Jessica_Kao3
Level 7
October 27, 2016

Hi Maggie,

You want to make sure that your sample size is large enough so you could run the test again, or it could simply mean that there is no difference.  If you are asking from a Marketo functionality how a winner is chosen, that's a different question entirely.  The likelihood of it being exactly 50.50 is pretty rare.  If you are choosing the winner manually and you get those results it means it doesn't matter and you can go with either one. 

I just wrote a blog on this topic.  You can find that here.  https://nation.marketo.com/community/champion/blog/2016/09/27/how-to-make-the-most-out-of-marketo-ab-test

    Terms & ConditionsAccessibility statement

    Loading footer...