Template for confidence calculation works incorrect

dradyuk

29-01-2020

https://docs.adobe.com/content/help/en/target/using/reports/conversion-rate.html#section_86F7C231943...

I've found template for calculating confidence for A/B tests. I need it to calculate confidence for custom metrics. At first I tried to verify if it works correct. I created regular A/B test and compare the results on 'report'-tab in target with the results from that excel-file.

1. If conversion rate is small ( less than 1%), then results are identical

2.If conversion rate is not so small ( greater than 2%), then results are not the same. Confidence in template is always greater.

 

What did I do wrong? 

Accepted Solutions (0)

Answers (0)