Does the Target Sample Size Calculator apply to CJA reporting? | Community
Skip to main content
M
madhuraj87
Level 2
November 19, 2025
Question

Does the Target Sample Size Calculator apply to CJA reporting?

  • November 19, 2025
  • 3 replies
  • 111 views

I often use the calculator to decide how long to run an A/B test. Up until recently we've just used Target as the reporting source, but have recently enabled CJA which we're beginning to use.

 

When using CJA to report out on Target activities (via the Experimentation Panel), I've noticed that the lift and confidence can take much longer to calculate than it would with the same page/page traffic in Target. Is this because we're applying the success metrics after the fact, rather than defining them within the VEC? And does that mean we should be using another calculator to determine test duration when using CJA as the reporting source?

 

Thanks in advance!

    3 replies

    S
    Adobe Employee
    SarthakBhAdobe Employee
    Adobe Employee
    January 27, 2026

    Target and CJA use different algorithms for statistics; Target uses a classical/Welch t‑test–based model.  Because Target and CJA are using different statistical models, they will not agree on duration/sample size. 

    You can refer to doc https://experienceleague.adobe.com/en/docs/analytics-platform/using/cja-components/cja-calcmetrics/cm-adv-functions#lift on how lift, confidence and other metrics are calculated in CJA

     

    Thank you! 

    Sarthak Bhatt | Senior Product Consultant | Customer Experience | Adobe  

      Perrin_Ennen
      Community Advisor
      Perrin_EnnenCommunity Advisor
      Community Advisor
      January 28, 2026

      Hi ​@madhuraj87,

      the Adobe Target Sample Size Calculator still applies when using CJA for reporting, because the underlying experiment design and assumptions do not change. However, CJA metrics are evaluated after exposure and require additional processing (ingestion, stitching, attribution), which can delay lift and confidence stabilization compared to native Target reporting. When using CJA as the primary reporting source, it’s best to plan for longer runtimes or add a buffer to the calculated duration, especially if success metrics are not defined in the Target activity itself.

       

      Hope this helps.

        M
        madhuraj87Author
        Level 2
        January 28, 2026

        This makes sense - thank you!

          Terms & ConditionsAccessibility statement

          Loading footer...