AB Test Email Results - which leads received which test email?

Question

I recently ran an AB whole email test between three emails. Once the test was complete I wanted to run a report to see which of our converted leads had received which of the test emails and I could only see that each record had been sent the "AB Whole Email" test (it did not provide the specific emails). This is a problem because regardless of how many people open/click the email I also wanted to see which test email performed the best when it came to conversions. Am I missing something or is there no way to see which records received which test emails after the test has deployed? I tried looking in the AB report and in the lead activity logs but no luck. Please advise - thanks!

Anonymous · Accepted Answer

Hello Julie Scotland!What may help you is to create a smart list to see which leads were sent which email. You can do this by using the "Test Variant" constraint. Just click on "add constraint" and you will be able to choose it. Then once you select the email test, the different emails you sent as a part of it will be available in the "test variant" drop down as shown below:You'll have to create a smart list for each different test variant (so in your case 3) but it should give you the information you're after!

Anonymous · Answer

Hi Julie,

I've run into this in the past, and you're right, you can't drill down into multiple metrics when it comes to email tests, which is a big flaw. You can, however, prevent this in the future by choosing a custom conversion metric as your winning criteria, which will help you choose a winner based on that metric instead of the standard opens & clicks.

To do this, when you set up your test the second page will ask you what your winner criteria should be, and just choose "Custom Conversion". From there you can build a smart list-like filter that will determine the conversion criteria you want.

I hope that helps!

Sign up

Login with SSO

Login to the community

Login with SSO

Scanning file for viruses.

This file cannot be downloaded