To monitor infrastructure settings, our team runs an AA test. This test is always live across web domain. Will this impact the audience selection for AB tests because we essentially run those AB tests on pages from the same web domain? Currently we have AA test set at priority 999 and AB tests with priority 0.
Hi @emmak109
Yes, running an live AA test on your web domain can potentially impact the audience selection for your AB tests, as both the AA and AB tests are being executed on the same web pages.
The reason for this is that the AA test, being set at a higher priority (999) than the AB tests (priority 0), will take precedence in serving the content to the users. This means that the audience exposed to the AA test will not be available for the AB tests, as they have already been served the content from the AA test.
To address this - Priorities your AB test over AA test (Change the priority), used the right audience for AB test ( exclude the audience who already came across AA test) and monitor impact and do adjustments as per your test objectives.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.