To monitor infrastructure settings, our team runs an AA test. This test is always live across web domain. Will this impact the audience selection for AB tests because we essentially run those AB tests on pages from the same web domain? Currently we have AA test set at priority 999 and AB tests with priority 0.
Solved! Go to Solution.
Topics help categorize Community content and increase your ability to discover relevant content.
Hi @emmak109
Yes, running an live AA test on your web domain can potentially impact the audience selection for your AB tests, as both the AA and AB tests are being executed on the same web pages.
The reason for this is that the AA test, being set at a higher priority (999) than the AB tests (priority 0), will take precedence in serving the content to the users. This means that the audience exposed to the AA test will not be available for the AB tests, as they have already been served the content from the AA test.
To address this - Priorities your AB test over AA test (Change the priority), used the right audience for AB test ( exclude the audience who already came across AA test) and monitor impact and do adjustments as per your test objectives.
Hi @emmak109
Yes, running an live AA test on your web domain can potentially impact the audience selection for your AB tests, as both the AA and AB tests are being executed on the same web pages.
The reason for this is that the AA test, being set at a higher priority (999) than the AB tests (priority 0), will take precedence in serving the content to the users. This means that the audience exposed to the AA test will not be available for the AB tests, as they have already been served the content from the AA test.
To address this - Priorities your AB test over AA test (Change the priority), used the right audience for AB test ( exclude the audience who already came across AA test) and monitor impact and do adjustments as per your test objectives.
Hi @emmak109 ,
Yes, I agree with @Gokul_Agiwal. A the both test cases are running on same web domain and AA has high priority.
In your case, AA activity has a higher priority, that content is displayed. So change the priority as per your request and define the audiences accordingly.
If multiple activities share priority level, there are two tiebreakers:
Views
Likes
Replies