A/B testing follow up emails | Community
Skip to main content
A
Anonymous
October 30, 2013
Solved

A/B testing follow up emails

  • October 30, 2013
  • 8 replies
  • 2302 views
Hi!

I am sending out an email to get people to download our new white paper. If they download the white paper, we want to send them a follow up email to visit our white paper hub - however for this follow up email we have two different designs we want to test.

Is it possible to split test a follow up email? The flow would be:

Send email
Wait 1 week
If opened email > send follow up email (this is where we want it to split test the follow up email)

Hopefully that makes sense... Please help!

Thanks
Hannah
This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by
Hi Hannah,

Yes you could do it that way--it would look like this:

*Smart List
<Trigger>Campaign is Requested via Marketo Flow Action
<Filter>If filled out form > is > white paper form
<Filter>Was Delivered Email > initial white paper email

*Flow
Send Email > Random Sample is 50 - Send Email 1
                     Default - Send Email 2

Is the white paper going to be accessible to everyone? Or would you like to send a follow up to all those who download it (from site and email) to visit the hub?

If so, you could set it up like this:

*Smart List
<Trigger>Fills out form > is > white paper form

*Flow
Wait > 1 Week
Send Email > Random Sample is 50 - Send Email 1
                     Default - Send Email 2

Feel free to set the 'wait' time to a couple minutes to test for yourself to make sure everything's running as you like.

8 replies

A
Anonymous
October 30, 2013
You can use 'Random split' function of 'Add to List' flow action. For 'Add to List' flow action, select 'Add Choice' and in the drop down select 'Random sample' and for 'Random sample' is '50', put in list A and 'Random sample' is '50', put in list B.

Then you can send different emails to list A and list B people. Some thing like,

Let me know if this helps.

Rajesh

A
Anonymous
October 30, 2013
Hi Hannah,

I think your best bet here would be to use the "Request Campaign" flow action on a new smart campaign with the emails split 50/50.

It would look something like this:

Original Campaign
Send Email
Wait 1 Week
If opened email > Request Campaign "Campaign Name"

New Campaign
*Smart List
Campaign is Requested via Marketo Flow Action
*Flow
Send Email > Random Sample is 50-Send Email 1
                     Else Send Email 2
A
Anonymous
October 30, 2013
FYI ...New AB Split test group and Champion Challenger feature becoming available in our December release!
    A
    Anonymous
    October 30, 2013
    I like Caleb's method too. Splitting them in different lists would make it a bit easier to analyze your A/B testing results.

    Rajesh

    A
    Anonymous
    October 31, 2013
    Hi all

    Thanks so much for your help!

    Caleb - I'm trying it the way you suggested. We want to only send the follow up email to people who downloaded the white paper from the first email though.

    Could I do original campaign as you suggested, the for the follow up split test campaign would it work if I did:

    *Smart List
    Campaign is Requested via Marketo Flow Action
    *Flow
    If filled out form > is > white paper form
    And recieved email > initial white paper email
    Then
    Send Email > Random Sample is 50 - Send Email 1
                              Default  - Send Email 2

    Thanks!
    A
    Anonymous
    Accepted solution
    October 31, 2013
    Hi Hannah,

    Yes you could do it that way--it would look like this:

    *Smart List
    <Trigger>Campaign is Requested via Marketo Flow Action
    <Filter>If filled out form > is > white paper form
    <Filter>Was Delivered Email > initial white paper email

    *Flow
    Send Email > Random Sample is 50 - Send Email 1
                         Default - Send Email 2

    Is the white paper going to be accessible to everyone? Or would you like to send a follow up to all those who download it (from site and email) to visit the hub?

    If so, you could set it up like this:

    *Smart List
    <Trigger>Fills out form > is > white paper form

    *Flow
    Wait > 1 Week
    Send Email > Random Sample is 50 - Send Email 1
                         Default - Send Email 2

    Feel free to set the 'wait' time to a couple minutes to test for yourself to make sure everything's running as you like.
    A
    Anonymous
    November 1, 2013
    Caleb you are the BEST! This is perfect, thank you so much for your help :-)
    A
    Anonymous
    November 1, 2013
    You're welcome, happy to help! :)
    Terms & ConditionsAccessibility statement

    Loading footer...