Skip to main content
Mikes_Jones
Mikes_Jones
Level 7
October 29, 2015
Solved

A/B Testing in Engagement Programs?

Is it possible to A/B test emails in an Engagement program, and if so, how?

Thanks!

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Dan_Stevens_
    Dan_Stevens_Accepted solution
    Level 10
    October 30, 2015

    Let me clarify: if you're using just emails in your EP, C/C will work. If you're using programs within your EP, C/C is not supported since the emails are being sent as a batch each cast. 

    View in thread

    13 replies

    Adobe Employee
    JohnCl9Adobe Employee
    Adobe Employee
    October 29, 2015

    Hi Malik,

    You can use the Champion/Challenger method for testing.  This creates a test as a sub-asset to a specific email so when you put that email in your engagement program it will call the test whenever it's sent.

    Email Tests - Champion/Challenger - Marketo Docs - Product Docs

    Translate
    Anonymous
    August 9, 2016

    Hey John,

    What happens if the email that is used in an engagement program is used in multiple streams? For instance, if the email is used in stream one, and then again in stream 3, and the lead received the email in stream one with subject line A, would the program call the email with subject line B in stream 3?

    Thanks,
    Alex

    Translate
    Dan_Stevens_
    Dan_Stevens_
    Level 10
    October 30, 2015

    As long as your emails aren't being batch sent. C/C only works with trigger based emails. And of course you cannot use an Email Program in an EP. 

    Translate
    Dan_Stevens_
    Dan_Stevens_Accepted solution
    Level 10
    October 30, 2015

    Let me clarify: if you're using just emails in your EP, C/C will work. If you're using programs within your EP, C/C is not supported since the emails are being sent as a batch each cast. 

    Translate
    Mikes_Jones
    Mikes_JonesAuthor
    Level 7
    October 30, 2015

    Hmm interesting. Yea, all of our emails in our Engagement Program are nested inside of a program - so with that being said, it looks like A/B testing is not possible, correct?

    Translate
    Anonymous
    January 26, 2016

    @Malik Zafar​ you don't need to use the Email Program to A/B test emails. You could also use the "Random Sample" option in your program.

    Translate
      Colin_Ryder
      Colin_Ryder
      Level 4
      January 26, 2016

      We don't use the email program at the moment so we do the same thing as Allison. A bit more manual but it is an option.

      It would be useful if Marketo were to enable A/B testing on batch campaigns as well. There is an idea here so feel free to like it

      Translate
        Anonymous
        January 27, 2016

        @Colin Ryder​ we manually A/B test our blasts and nurtures! I'd love to hear more about your challenges. Here's the template we use to track our email A/B tests​. I'm posting a blog post on how we A/B test our emails very soon. I'll be sure to share it with you!

        Translate
          Terms & ConditionsAccessibility statement

          Loading footer...