Treatment A/B testing | Community
Skip to main content
A
Ajo_WisdomChase
Level 4
December 10, 2024
Solved

Treatment A/B testing

  • December 10, 2024
  • 1 reply
  • 564 views

Hi Community,

I have two doubts regarding the treatment


Question 1:

I am running an A/B test with 100 audience members, where 10% (10 people) are assigned to Treatment A, 10% (10 people) are assigned to Treatment B, and the remaining 80% (80 people) are in the holdout group. You're using open rate as your metric to compare the effectiveness of Treatment A and Treatment B. After determining which treatment has the best open rate, you'd like to automatically send the remaining 80% of emails to the winning treatment group.

Question 2:

The sentence "In Experiment report I could see only 7 day to determine the winner its possible to change the time line?
"This Experiment has run for Less than 7 days" what mean this?

@satheeskannak @anuhya-y @mohan_dugganab @davidkangni 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Anuhya-Y

@ajo_wisdomchase 

Automatically selecting the winning treatment and targeting holdout profiles is not available now, but this feature is on the product roadmap.

 

Finalizing the best treatment will take some time. The error shows that at least 7 days must be given to decide on the winning treatment. https://experienceleague.adobe.com/en/docs/journey-optimizer/using/reporting/channel-report/reporting/campaign-global-report-cja-experimentation

1 reply

Anuhya-Y
Community Advisor
Anuhya-YCommunity AdvisorAccepted solution
Community Advisor
December 11, 2024

@ajo_wisdomchase 

Automatically selecting the winning treatment and targeting holdout profiles is not available now, but this feature is on the product roadmap.

 

Finalizing the best treatment will take some time. The error shows that at least 7 days must be given to decide on the winning treatment. https://experienceleague.adobe.com/en/docs/journey-optimizer/using/reporting/channel-report/reporting/campaign-global-report-cja-experimentation

Terms & ConditionsAccessibility statement

Loading footer...