A/B Test where half the audience gets email and half gets nothing | Community
Skip to main content
Level 1
January 10, 2023
Question

A/B Test where half the audience gets email and half gets nothing

  • January 10, 2023
  • 2 replies
  • 1183 views

Hello! Does anyone have suggestions on the best way to create an A/B test for a blast email where half the audience receives an email and half receives nothing? Thanks!

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

2 replies

JaceBr
Level 3
January 10, 2023

I'm curious what the use case for this is, so if you can expand on that I'd appreciate it.

However, you can do this via a smart campaign instead of an email program. If you create a smart campaign with your full list in the smart list, then add a flow step to send the email with a choice to select a random sample of 50% to get the email and the rest "do nothing"

you'll need to pull an email performance report to make any decisions.

 

Darshil_Shah1
Community Advisor and Adobe Champion
Community Advisor and Adobe Champion
January 10, 2023

If you’re using the OOTB A/B test available in the email program, then you need to set the test sample size in the A/B test settings to determine the sample size for the qualified people to receive the test emails and the winner email. If you don’t want a portion of people to receive emails from this blast then why not filter them out in the smart list itself? 

 

Do you have any specific use-case/need where in you’re not able to suppress the people you don’t want to send any (test/winner) emails qualify for the send? Let’s back-track a bit to understand and analyze the use-case so as to potentially avoid an XY problem here.