AB testing whole emails : where are the reports on the challenger emails' performances ? | Community
Skip to main content
ainarako
ainarako
Level 1
April 27, 2023
Solved

AB testing whole emails : where are the reports on the challenger emails' performances ?

  • April 27, 2023
  • 1 reply
  • 1893 views

Hey everyone, 

 

I'm pretty new in email automation and would really need some help in regards to AB testing whole emails.

 

I'm working on an abandoned cart campaign where I'm AB testing 2 same mails with different sales (10% off and 15% off). I set it up in half (50% champion /50% challenger) and set up my reports to be sent every 3 weeks as to check progression. 

 

Since the start of the campaign (December 2022), I've received no reports in regards to email performances (realized it a bit late I know) and I've been trying to get them straight from Marketo but I actually have no idea where. 

 

Any help would be much appreciated! 

Thank you!

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Darshil_Shah1

The email report might have got quarantined/blocked by the privacy filters. If you just select your champion challenger email in an email performance report's setup tab, Marketo would show the results/performance data of both versions in a single line item instead of breaking it out by variants.

 

To get the results broken by variants, you can add the "Was Sent Email Filter" Email is <Select the Email> and Add the "Test Variant" constraint in the report's smart list and then check the email metrics of each variant individually. 

However, it's worth mentioning here that Marketo retains the Send Email activity for 90 days from the date of activity.

 

1 reply

Darshil_Shah1
Community Advisor and Adobe Champion
Darshil_Shah1Community Advisor and Adobe ChampionAccepted solution
Community Advisor and Adobe Champion
April 27, 2023

The email report might have got quarantined/blocked by the privacy filters. If you just select your champion challenger email in an email performance report's setup tab, Marketo would show the results/performance data of both versions in a single line item instead of breaking it out by variants.

 

To get the results broken by variants, you can add the "Was Sent Email Filter" Email is <Select the Email> and Add the "Test Variant" constraint in the report's smart list and then check the email metrics of each variant individually. 

However, it's worth mentioning here that Marketo retains the Send Email activity for 90 days from the date of activity.

 

    ainarako
    ainarakoAuthor
    Level 1
    April 28, 2023

    Thanks Darshil!

    I'll try it out and see how it goes.

    Cheers

    Terms & ConditionsAccessibility statement

    Loading footer...