AB Test Whole Emails in Engagement Program | Community
Skip to main content
March 31, 2015
Solved

AB Test Whole Emails in Engagement Program

  • March 31, 2015
  • 9 replies
  • 3317 views
We have an active Engagement Program turned on with only one Stream that has 3 emails in it. We would like to AB test two whole emails with a random distribution of records for the first email.

Any recommendations on how to set this up?

Thanks in advance!
This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by
Please excuse the blackouts :)




9 replies

March 31, 2015
I'd recommend using programs within your engagement stream and a smart campaign to define your members and the A/B flow steps. Programs open up another world of fun you wouldn't really be able to do otherwise.

How I structured my A/B testing is by cloning the email and making my changes on the clone. Using the native A/B test feature within Engagement programs has caused problems. There's disucssions on this throughout the community.

Within your flow step of the smart campaign, use the random sample restrain to define your split.

After your program is all set place it into the nurture and when prompted, select your Smart Campaign you just built to ensure your email gets pulled into the native engagement program send.

I have screenshots if you need.
March 31, 2015
Thanks for the qick response Tim! Yes I want to avoid using the Champion/Challenger by all means! Can you share screen shots of what you built? Much appreciated!
Accepted solution
March 31, 2015
Please excuse the blackouts :)




April 3, 2015
Thanks so much for sending the screen shots Tim! Did you setup the smart campaign in your program as a bi-weekly batch? How does the campaign/stream know when to fire the email?
April 3, 2015
You can set your smart campaign like any other. No need to schedule things out. Drop the program in your stream. It will prompt you to select the campaign you just made. Use the streams program cadence as the sending mechanism. The engagement program naturally u sweat and to send on the days and times you set.
April 3, 2015
Ah Gotcha! Thanks...was curious how that work but totally making sense now!
April 3, 2015
Sorry to bug you again Tim! What are the pros and cons of using a Program versus Champion/Challenger for AB Testing?
April 3, 2015
Programs can use both trigger and batch campaigns to A/B test while using champion challenger restricts you to just using trigger campaigns. Marketo says they work in engagement programs, but the documentation on this is conflicting. Basically there is no pro or con it's just you can't use champion challenger in all situations. Wish this wasn't so, I like the idea of champion challengers.
April 4, 2015
Thanks Tim!