Hey,
We've recently implemented Target at my work having moved away from Optimizely, so apologies if these issues seem very basic. I have looked on the forums but to no avail.
We've had a fair few issues with A/B tests, so far we've only used manual allocation so the issues pertain to that. Hopefully our problems are connected and there's one cause we're not quite seeing.
Firstly, as the title suggests the splits are not matching what we set the allocation at when we look at unique visitors (we're using Adobe Analytics). 50:50 tests have tended to go 60:40, and a 60:20:20 test went 70:15:15.
Another issue we're seeing is a test that ran with no difference between A and B saw an uplift of roughly 8% at 99.99% interval - which obviously seems very unlikely.
There are a few other small issues that mean we currently can't really trust our results but those are the main ones.
As I say we're fairly new to Target so any help/possible suggestions would be greatly appreciated - we haven't had much luck emailing our contacts at Adobe.
Thank you,
Jordan