Skip to main content
July 14, 2014
Question

A/B Test in Engagement Program not sending Challengers

  • July 14, 2014
  • 14 replies
  • 2908 views
I have an A/B champion test on subject lines set up for one of my email programs inside an engagement program. 

We set it live this weekend where those who fill out a form are triggered to enter the stream. My cadence is set for every day and I've recieved over 40 people this weekend to enter the stream.

So far my results are showing that the program is only sending the champion email and no challengers. I have not declared a winner yet.

Any reason why this may be happening?


This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

14 replies

July 14, 2014
What percentage do you the Champ versus Challenger set to?
July 14, 2014
25% to the Champ and 75% to the Challengers 
Dory_Viscoglio
Level 10
July 14, 2014
Timothy, has everything been approved? Both of the emails as well as the program itself need to be approved in order for the send to work properly.
July 14, 2014
Its just one email split into an A/B subject line test (2 competitors). Everything has been approved. My send sample test properly sends all 3 variations. 


July 14, 2014
Hi Timothy,

It might be best to call into Marketo support to see if they can help.  

Thanks,
Cheryl
July 14, 2014
Called in a ticket. Still waiting to be resolved.

From diving in further, the engagement program is not correctly sending the champion challenger...
July 15, 2014
I have confirmed that there is a bug.  Engineering is working on a fix - it might take a day or so to fix, test and push it out.
July 15, 2014
Thank you Cheryl. I appreciate the update.
July 18, 2014
Has this issue been resolved?  We did a champion challenger email on 7/15 and it doesn't look like the challenger was sent. 
July 18, 2014
Don't think so. I'm not experiencing issues with my engagement program not sending emails to those added to the stream....