Expand my Community achievements bar.

Ask our product team on how to best grow your experimentation and personalization strategies with Target during our AMA on May 6th!

Mark Solution

This conversation has been locked due to inactivity. Please create a new post.

SOLVED

Multivariate AB-Test [Singular Experience Dominance]

Avatar

Level 1
I am implementing a 5x5 multivariate test.  After filling out the campaign with the "designed" components, I activated the test.  In order to see the alternate experiences, I cleared the cookies & cache, but we've only received two experiences out of a possible 25 experiences after dozens of cache clearing.  
 
The oddity behind the two experiences was that one experience remained by & large dominate. The second experience only showed after clearing the cache 20 times, and then on a follow-up cache-clear it would revert to the first experience.  I tried setting up a separate test, but a similar experience was generated.  
 
Is there a secondary component missing that will fix the near static experience?  Or is this functionality how the test is setup?
1 Accepted Solution

Avatar

Correct answer by
Level 2

- In order to be able to see an experience directly you can use URL parameters for offer level targeting.

- if you are testing the random/even distribution among offers, you will need to wait until a large amount of visits is counted. I have experienced differences of 30-50 visits at the very beginning of the test, but the bigger the amount of visits gets, the more even the distribution on the experiences gets. 

- If you are stucked with the default experience, then you are probably getting a timeout and TnT is blocking the test for 15 mins. 

View solution in original post

1 Reply

Avatar

Correct answer by
Level 2

- In order to be able to see an experience directly you can use URL parameters for offer level targeting.

- if you are testing the random/even distribution among offers, you will need to wait until a large amount of visits is counted. I have experienced differences of 30-50 visits at the very beginning of the test, but the bigger the amount of visits gets, the more even the distribution on the experiences gets. 

- If you are stucked with the default experience, then you are probably getting a timeout and TnT is blocking the test for 15 mins.