Where to find Standard Error in Adobe Target results? | Community
Skip to main content
E
emmak109
Level 3
August 10, 2023
Solved

Where to find Standard Error in Adobe Target results?

  • August 10, 2023
  • 1 reply
  • 2358 views

I am trying to locate the standard deviation calculated for an A/B test variants? Where can I find those in the reports?

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Best answer by PratheepArunRaj

    Dear @emmak109 ,

    Ignore the UI, calculations are still the same. Did you go through the link shared?

    The link had an option to perform the calculations offline (Attached here) and can be used. See whether it is useful to you.

    Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

    1 reply

    PratheepArunRaj
    Community Advisor and Adobe Champion
    PratheepArunRajCommunity Advisor and Adobe Champion
    Community Advisor and Adobe Champion
    August 14, 2023

    Dear Emma,

    Standard Deviation is not a direct metric in Target Activities for consumption.

    Deviations are used to calculate the Confidence Level. Calculations for A/B/n activities are here.

    Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

    Thank You, Pratheep Arun Raj B (Arun) | Xerago | Terryn Winter Analytics
      E
      emmak109Author
      Level 3
      August 14, 2023

      Oh no! The link you shared looks so different from the current UI of Adobe Target. The only range I see in the current UI is 'range of Lift (Low, Middle, High)' - which is usually the difference in the KPI I am measuring. To be able to make correct interpretation of the test results (not just on the basis of Confidence - p values or Lift range), I need to see how much variation occurs in the normal distribution of KPI in both Control and Treatment groups. The reason I am asking this is data looks flaky to me - we have 97% confidence (0.03 pvalue) despite of extremely high range in lift (from negative: -78 to positive: 13). I need to find answer to this and that is why I wanted to look at the confidence interval range for the KPI I am using for this test. If it is not available in Adobe Target, then what workaround do you suggest?

        PratheepArunRaj
        Community Advisor and Adobe Champion
        PratheepArunRajCommunity Advisor and Adobe ChampionAccepted solution
        Community Advisor and Adobe Champion
        August 14, 2023

        Dear @emmak109 ,

        Ignore the UI, calculations are still the same. Did you go through the link shared?

        The link had an option to perform the calculations offline (Attached here) and can be used. See whether it is useful to you.

        Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics

        Thank You, Pratheep Arun Raj B (Arun) | Xerago | Terryn Winter Analytics
          Terms & ConditionsAccessibility statement

          Loading footer...