Your achievements

Level 1

0% to

Level 2

Tip /
Sign in

Sign in to Community

to gain points, level up, and earn exciting badges like the new
Bedrock Mission!

Learn more

View all

Sign in to view all badges

cki_phylo
cki_phylo
Offline

Badges

Badges
4

Accepted Solutions

Accepted Solutions
1

Likes Received

Likes Received
2

Posts

Posts
3

Discussions

Discussions
0

Questions

Questions
3

Ideas

Ideas
0

Blog Posts

Blog Posts
0
Top badges earned by cki_phylo
Customize the badges you want to showcase on your profile
Re: Why the sample size calculator over estimates the sample real needed? - Adobe Target 09-02-2017
Dear miguelm62125791, I'm sorry to say your reasoning is not correct. The science of AB-testing is complex, nuanced and highly-specific; without going into too much detail all I can tell you is that even if the UI shows 99.9% confidence it doesnt mean absolutely anything (as in, it doesnt mean that you have a 0.01% false-positive rate) if the minimum sample size has not been achieved.

Views

2.1K

Likes

0

Replies

0
Re: Why the sample size calculator over estimates the sample real needed? - Adobe Target 09-02-2017
Hi, this is because Target is a tool and it can be used however the user desires. More specifically, Target doesnt know the test's sample size and so it continues to show Confidence even when the value is not valid.

Views

2.2K

Like

1

Replies

0
Re: Why the sample size calculator over estimates the sample real needed? - Adobe Target 08-02-2017
Hi Rohit, I'm a product manager on Target and let me try to address your concern. First and most importantly, the sample size calculator does not provide an estimate. It stipulates the minimum sample size required in order to guarantee that your false-positive rate (ie inverse of Confidence) is bounded. Which means that if you desire a 95% confidence (or 5% false-positive rate), you MUST wait until this sample size has transpired in order to guarantee that only 1 out of 20 times (ie 5%) will a t...

Views

2.5K

Like

1

Replies

2
Likes from