Excluding one A/B test's traffic from another A/B test

[adam_greene]

Here's the scenario:

Test 1 is on the main landing page. 

I want to create a second test (Test 2) whose test page will be two pages farther into the funnel from Test 1.

Test 2's test page cannot be accessed directly. Any traffic that visits Test 2's test page can only get to that page if they have first visited Test 1's test page.

I would prefer that the two tests remain mutually exclusive from one another for cleaner data. So, in order to do that I must:

1) Reduce the amount of traffic Test 1 is consuming. If Test 1 consumes all the traffic from its test page there won't be any traffic that hits Test 2's test page that hasn't already been subjected to Test 1. So, Test 1's traffic must be reduced in order to let some 'untainted traffic' flow through to Test 2's test page

2) Set up an exclusion rule on Test 2 saying that all traffic that was subjected to Test 1 should be excluded from entering Test 2. The remaining traffic that has not been subjected to Test 1 will be entered into Test 2. 

I believe those are the two steps that would need to be completed in order to have to 'clear lanes of untainted traffic' for both tests.

Can this be done in Adobe Target?

Thanks!

Adam

[ParitMittal · Accepted solution]

Hi Adam,

Yes , you are Almost correct in your Methodology to make two tests mutually exclusive . However just to add to your point 1,  You can either apply an Audience ( say Visitors From Search Engine, Organic Traffic etc) to Test 1 so that only some % of Visitors visiting the main landing page are exposed to Test1 or if you are Exposing "ALL Visitors"  to the Test1 on landing page ,You can specify the percentage of qualifying visitors to include in the activity. For example, you might choose to include 50% of all visitors.

Also, To attain point 2 i.e. Only Expose Test2  to the Traffic which has not been exposed with Test1 , you have to  to set a profile on visitors who Enters test1 on the Landingpage. Target the Test2 to users who have not entered the Test1.  Please follow the below steps to achieve the same.

1. Create a profile script named  "Test1"  and in that  return a value to this profile for customers who enters the Test1.Please see below:

2. Create another profile script named "Test2" to check if that visitor have been to the Test1 or not  and then return a value accordingly i.e. "Enter Test2" or "Not Enter Test2"

3. After All the set up , You can create an Audience named as "Test2-Audience" and add "Visitor Profile" as a rule and then choose the above created profile script "user.Test2"  as the refinement.

4. Finally Apply the Audience created above to Test-2.

 Please see the following links for more information on creating profile scripts .

https://marketing.adobe.com/resources/help/en_US/target/target/c_profile_parameters.html

https://marketing.adobe.com/resources/help/en_US/target/target/c_script_profile_attributes.html

https://marketing.adobe.com/resources/help/en_US/tnt/pdf/js_expression_cheat_sheet.pdf

Thanks & Regards

Parit Mittal

[ParitMittal]

Hi Adam,

Yes , you are Almost correct in your Methodology to make two tests mutually exclusive . However just to add to your point 1,  You can either apply an Audience ( say Visitors From Search Engine, Organic Traffic etc) to Test 1 so that only some % of Visitors visiting the main landing page are exposed to Test1 or if you are Exposing "ALL Visitors"  to the Test1 on landing page ,You can specify the percentage of qualifying visitors to include in the activity. For example, you might choose to include 50% of all visitors.

Also, To attain point 2 i.e. Only Expose Test2  to the Traffic which has not been exposed with Test1 , you have to  to set a profile on visitors who Enters test1 on the Landingpage. Target the Test2 to users who have not entered the Test1.  Please follow the below steps to achieve the same.

1. Create a profile script named  "Test1"  and in that  return a value to this profile for customers who enters the Test1.Please see below:

2. Create another profile script named "Test2" to check if that visitor have been to the Test1 or not  and then return a value accordingly i.e. "Enter Test2" or "Not Enter Test2"

3. After All the set up , You can create an Audience named as "Test2-Audience" and add "Visitor Profile" as a rule and then choose the above created profile script "user.Test2"  as the refinement.

4. Finally Apply the Audience created above to Test-2.

 Please see the following links for more information on creating profile scripts .

https://marketing.adobe.com/resources/help/en_US/target/target/c_profile_parameters.html

https://marketing.adobe.com/resources/help/en_US/target/target/c_script_profile_attributes.html

https://marketing.adobe.com/resources/help/en_US/tnt/pdf/js_expression_cheat_sheet.pdf

Thanks & Regards

Parit Mittal

[adam_greene]

This is great! Thank you very much!

[adam_greene]

This is great! Thank you very much!