A/B test result and Email Performance report don't match | Community
Skip to main content
KanakoTone
KanakoTone
Level 4
January 14, 2016
Solved

A/B test result and Email Performance report don't match

  • January 14, 2016
  • 3 replies
  • 1988 views

Hi,

I ran the first Engagement Program today, and am very excited to see the result.

The first content is an email nested under the EP, and I set up A/B testing.

As I'm preparing the Email Performance report, I realized difference in # of open. (*Email Performance report is also nested under the EP. Smart List has a filter for members of this EP.)

This is what looks like on the dashboard on the local Email asset. The total number of open is 46.

While,the Email Performance report shows that the number of open is only 18.

Why are they different, and which one should I rely on?

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by KanakoTone

It seems like just a delay in Marketo. This morning, the numbers are matching correctly.

3 replies

Dory_Viscoglio
Dory_Viscoglio
Level 10
January 14, 2016

Hey Kanako, the email performance report likely isn't reporting on both the champion and challenger subject lines. I'd rely on the A/B test dashboard.

A
Anonymous
January 15, 2016

Do you have two campaigns for sending each email in the test? If yes, then you can set up a "campaign email performance"...

I was also struggling with different numbers depending on reports until I started using this report, I find it most useful.

KanakoTone
KanakoToneAuthorAccepted solution
Level 4
January 15, 2016

It seems like just a delay in Marketo. This morning, the numbers are matching correctly.

Terms & ConditionsAccessibility statement

Loading footer...