No winner for A/B Test

Hi Erica, I wouldn't assume that Marketo won't arbitrarily send one as the winner based on previous experiences. If it's possible, I'd wait until your test is scheduled to end, and if it doesn't send a winner you can set up a smart campaign to the same audience except add an additional AND filter that says "not was sent email: email x or email y". This way, you won't send to people who already received either email in the test.

But like I said, I think it will most likely send one of your emails as the winner. 

Agreed, I've had the same experience as Tara but only a handful of times. Unless you're only changing something SUPER minor, the winner should be sent. Although I would try and set up future tests to run a bit longer than 24 hrs. Perhaps 48-72 if you can! People really do tend to open emails after a few days (depending on your businesses and send dates). 

 

Agree with above, you must let it wait 48-72 hours as Kristen says before you have actionable data.

Also, try to have at least 300 people in the test sample. Even though 30 would be the rule of thumb, you likely won't get useful data from a 30 person sample. I posted a statistical significance calculator elsewhere, but you can do a search for one online.

For reference, here's a great significance calculator for your toolbox:
getdatadriven.com/ab-significance-test

Thank you all for your insight. It is all very helpful. In the event of a tie, the first test in the A/B test is declared the winner. Thank you.