Testing different subject lines | Community
Skip to main content
A
Anonymous
June 6, 2013
Solved

Testing different subject lines

  • June 6, 2013
  • 8 replies
  • 2072 views
Maybe it's me,  but when I read all the articles, then try to actually do it,  it's not very clear.  I have 1 email with 2 different subject lines.  I want half the group (about 750 names) to get 1 version,  the rest to get the other.  I don't care how the split occurs.

My campaign is built around the titles of people, not a specific list.  

HELP!  I could use some pointers of the easiest way to do this. 
This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by
Deb,

The easiest way to split-test an email is to create the campaign as you normally would and in the "Send Email" flow step, add a "Random Sample" constraint that sends half the population email A and half email B.

For 3-way tests, the percentages you'd use for Random Sample would be 33, 33, etc.

8 replies

A
Anonymous
Accepted solution
June 7, 2013
Deb,

The easiest way to split-test an email is to create the campaign as you normally would and in the "Send Email" flow step, add a "Random Sample" constraint that sends half the population email A and half email B.

For 3-way tests, the percentages you'd use for Random Sample would be 33, 33, etc.

    A
    Anonymous
    June 7, 2013
    Hi Deb - The above from Charlie is a very good example of how the campaign works :)

    I think maybe a point of confusion here lies in the statement "I have one email with two different subject lines".

    It would be more accurate to say "I have two emails, each with a different subject line but otherwise identical, labelled EmailA and EmailB."

    Using the Random Sample method Charlie has described above, you then send EmailA to the first 50%, and EmailB to the second 50%. Marketo then randomly sends Emails A and B to the list (it's totally OK to build your smart list using job titles, it doesn't impact the send process).

    Does that ease any of your confusion?

      A
      Anonymous
      June 7, 2013
      I would like to complement the clever suggestions posted by Charlie and Veronica: the article "Random Sample Made Easy" provides a simple and robust method to define your test groups.
      http://community.marketo.com/MarketoArticle?id=kA050000000L6EBCA0
      A
      Anonymous
      June 7, 2013
      thanks for everyone's input.  Here's what I did.  I created a smart list of the titles i want included in the campaign.  Then in the flow,  I showed the random sample at 50% and show the 2 emails.  Here's a screen shot.  What do you think - will this work?

      A
      Anonymous
      June 7, 2013
      This works, although you could also have just one Choice at 50% and the rest will go to default.
      A
      Anonymous
      June 7, 2013
      Thank you so much. 
      A
      Anonymous
      October 8, 2013
      Can I apply this method to an ongoing smartlist that will continue to gain new leads or does this only work with a predefined list?
      A
      Anonymous
      October 8, 2013
      This would work with both types of lists. Marketo will always check membership when the particular lead hits that step.
      Terms & ConditionsAccessibility statement

      Loading footer...