Create an A/B test Email program | Community
Skip to main content
N
nishanth27
Level 3
December 13, 2024
Solved

Create an A/B test Email program

  • December 13, 2024
  • 1 reply
  • 2609 views

Hello folks,

 

Quick question on AB test set up:

 

I have set a simple A/B test for whole emails in an Email Send program which is tied to a CRM campaign code. Now, under the same program, can I create another AB test possibly nesting another email program housed under the main Email Send program in any way? I understand an email program can have one one AB test in it. 

Please advise.

 

Thanks

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Best answer by ilona_buteneers

    Hi @nishanth27 

     

    Each Email Program can only have one single A/B test. And it is not possible to nest one Email Program in another Email Program. 

    What you could do is creating a Default Program and nest 2 separate Email Programs in that Default one. 

     

     

    Another way of working with multiple A/B tests in a Program, is working with Smart Campaigns and the following elements: 

    1.  Creating samples and adding the records to a Static List (the filter you use in your Smart List criteria is called "Random Sample")
    2. A Smart Campaign to send version A to the first random sample you created (Static List n°1) and to send the B version to the second random sample you created (Static List n°2). Of course you can expand this depending on how many versions you'd like to test. 

    As you can see, this requires a little more manual effort. 

     

    Hope this helps you going in the right direction. 

    Don't hesitate to reach out in case you have more questions on this. 

    Happy to help. 

     

    Kind regards, 

    Ilona 

    1 reply

    ilona_buteneers
    Adobe Champion
    ilona_buteneersAdobe ChampionAccepted solution
    Adobe Champion
    December 13, 2024

    Hi @nishanth27 

     

    Each Email Program can only have one single A/B test. And it is not possible to nest one Email Program in another Email Program. 

    What you could do is creating a Default Program and nest 2 separate Email Programs in that Default one. 

     

     

    Another way of working with multiple A/B tests in a Program, is working with Smart Campaigns and the following elements: 

    1.  Creating samples and adding the records to a Static List (the filter you use in your Smart List criteria is called "Random Sample")
    2. A Smart Campaign to send version A to the first random sample you created (Static List n°1) and to send the B version to the second random sample you created (Static List n°2). Of course you can expand this depending on how many versions you'd like to test. 

    As you can see, this requires a little more manual effort. 

     

    Hope this helps you going in the right direction. 

    Don't hesitate to reach out in case you have more questions on this. 

    Happy to help. 

     

    Kind regards, 

    Ilona 

      N
      nishanth27Author
      Level 3
      December 13, 2024

      Thanks @ilona_buteneers Appreciate the response.

       

      Could you kindly explain a little bit more about the other way of creating Ab tests (with Random Samples) with screenshots if possible. I want to make sure I understood right. Not sure if we can add records to a static list from smart lists

       

      Also, looks like this set up sends versions of emails to sample percentage of the audience but the outcome of one the tests will be the winner right. So how is this set up going to send the winner to the rest of the audience?

      Winner email has to be manually determined and launched?

       

      Note: my target audience is inside a smart list

       

      Regards,

      Nishanth

      ilona_buteneers
      Adobe Champion
      ilona_buteneersAdobe Champion
      Adobe Champion
      December 13, 2024

      Hi @nishanth27 

       

      Please see attached a screen recording in the Word document of different steps to take. (I was not able to upload video directly into this message). In this set-up I created a separate Smart Campaign to send out the emails, but I believe you can also do everything in one Smart Campaign (creating the samples by adding them to a list - include a wait step - send out the email). 

       

      After you ran the manual A/B test, you also would have to create Email Performance Report to define the winner. 

      You can then send the winner to the remainder of the audience and make sure to exclude the samples you created. 

      Hope this helps! 

       

      Kind regards, 

      Ilona 

       

        Terms & ConditionsAccessibility statement

        Loading footer...