Where to find Standard Error in Adobe Target results?

Forum|Forum|2 years ago
August 10, 2023
1 reply
2369 views

I am trying to locate the standard deviation calculated for an A/B test variants? Where can I find those in the reports?

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

Best answer by PratheepArunRaj

Dear @emmak109 ,

Ignore the UI, calculations are still the same. Did you go through the link shared?

The link had an option to perform the calculations offline (Attached here) and can be used. See whether it is useful to you.

Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

PratheepArunRaj

Community Advisor and Adobe Champion

Dear Emma,

Standard Deviation is not a direct metric in Target Activities for consumption.

Deviations are used to calculate the Confidence Level. Calculations for A/B/n activities are here.

Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

Thank You, Pratheep Arun Raj B (Arun) | Xerago | Terryn Winter Analytics

E

emmak109Author

Level 3

Oh no! The link you shared looks so different from the current UI of Adobe Target. The only range I see in the current UI is 'range of Lift (Low, Middle, High)' - which is usually the difference in the KPI I am measuring. To be able to make correct interpretation of the test results (not just on the basis of Confidence - p values or Lift range), I need to see how much variation occurs in the normal distribution of KPI in both Control and Treatment groups. The reason I am asking this is data looks flaky to me - we have 97% confidence (0.03 pvalue) despite of extremely high range in lift (from negative: -78 to positive: 13). I need to find answer to this and that is why I wanted to look at the confidence interval range for the KPI I am using for this test. If it is not available in Adobe Target, then what workaround do you suggest?

Amelia_Waliany

Adobe Employee

Thank you for mentioning this!

I am still confused on what exact segment I need to apply and where? Are you saying after the test is completed, I should create a segment out of treatment group (variant)?

Thanks for keeping the inquiry up @emmak109, and thanks @pratheeparunraj for your always-helpful guidance here on the thread! Wondering if any of our fellow Adobe Target Community Advisors and/ or Adobe Target Community Mentors might be able to weigh in and help clarify further?

CC our brilliant Advisors: ambikaTewari_ATCI, Andrew_Wathen_, Avinash_Gupta_, Eric_Vidana, Gokul_Agiwal, Perrin_Ennen, Rajneesh_Gautam_, and Umamaheswari_Yakkala

and our inspiring Mentors:

@abhilashsape, @Gokul_Agiwal, @Rajneesh_Gautam_, @PratheepArunRaj, and @Sneha-Parmar