Skip to main content
Level 4
December 10, 2024
Répondu

Treatment A/B testing

Hi Community,

I have two doubts regarding the treatment


Question 1:

I am running an A/B test with 100 audience members, where 10% (10 people) are assigned to Treatment A, 10% (10 people) are assigned to Treatment B, and the remaining 80% (80 people) are in the holdout group. You're using open rate as your metric to compare the effectiveness of Treatment A and Treatment B. After determining which treatment has the best open rate, you'd like to automatically send the remaining 80% of emails to the winning treatment group.

Question 2:

The sentence "In Experiment report I could see only 7 day to determine the winner its possible to change the time line?
"This Experiment has run for Less than 7 days" what mean this?

@satheeskannak @anuhya-y @mohan_dugganab @davidkangni 

Ce sujet a été fermé aux réponses.
Meilleure réponse par Anuhya-Y

@ajo_wisdomchase 

Automatically selecting the winning treatment and targeting holdout profiles is not available now, but this feature is on the product roadmap.

 

Finalizing the best treatment will take some time. The error shows that at least 7 days must be given to decide on the winning treatment. https://experienceleague.adobe.com/en/docs/journey-optimizer/using/reporting/channel-report/reporting/campaign-global-report-cja-experimentation

1 commentaire

Anuhya-YCommunity AdvisorRéponse
Community Advisor
December 11, 2024

@ajo_wisdomchase 

Automatically selecting the winning treatment and targeting holdout profiles is not available now, but this feature is on the product roadmap.

 

Finalizing the best treatment will take some time. The error shows that at least 7 days must be given to decide on the winning treatment. https://experienceleague.adobe.com/en/docs/journey-optimizer/using/reporting/channel-report/reporting/campaign-global-report-cja-experimentation