Is there any way to check whether AB test is having flicker effect?

[Ramya_SR]

Traffic is split 50/50% between control and variation. The data analysis shows sample size mismatch. 

[PratheepArunRaj · Accepted solution]

Dear Ramya,

When you say flicker, are you saying that Control is loading more due to the flicker creating the size mismatch?

If yes, it should not be the case since the traffic is counted only when the offer is delivered (Either it is control or variation).

The unequal split is common during the initial days and settles over a week. Just continue with the test and see whether the numbers are normalizing in a week or so. If not, reach us back.

Thank You, Pratheep Arun Raj B (Arun) | NextRow Digital | Terryn Winter Analytics