Mutually Exclusive setup is sending customers to multiple tests

[AndyWo5]

Morning.  We have 2 mutually exclusive audiences created using profile scripts as you would expect:

• MutualGroupA 2groups
• MutualGroupB 2groups

These both use the profile script MutuallyExclusive2Groups which has the following script:

if (!user.get('twogroups')) {
    var ran_number = Math.floor(Math.random() * 100);
    if (ran_number <= 49) {
        return 'GroupA';
    } else {
        return 'GroupB';
    }
}

We then have 2 tests in Target created:

Test 1 serving 2 experiences using the audience MutualGroupA 2groups and
Test 2 serving 2 experiences using the audience MutualGroupB 2groups.

We have data coming into Analytics, but oddly, when we total each of the 4 experiences in the Visits it doesn't match the Visits total when we don't filter the A4T segements. 

You can see that the 4 columns total SHOULD match the first column, but it comes back with 2,638 (~400 more).  The second column segment is just connecting ALL 4 exepriences into 1

VISIT
Analytics for Target equals any of 609174:0:0, 609174:1:0
- OR -
Analytics for Target equals any of 609175:1:0, 609175:0:0

But this total doesn't even match the total of the 4 columns added together.

I then created 2 HIT segements to see A4T that matches Test 1 AND Test 2 

HIT
Analytics for Target starts with 609174
- AND -
Analytics for Target starts with 609175

and we have some data, indicating that customers are being sent to both tests when the mutually exclusive setup should stop this.

I'm at a loss as to why we are seeing customers being entered into each of the tests when they should only be entered into 1 or the other and THEN see experience A or B.

[ycooreman · Accepted solution]

I can't see the full setup, but you are very likely getting all visits from all of those users who entered the activities, not just the visits for the activities.

Use impressions if you want exact counts for your bucketing