Entrants in A/B Test

picklespug 15-10-2015

I've set up a few activities on our site, one that targets returning customers and another that targets new visitors. The number of entrants seems very low. (Only 1k over the course of a week or two). 

I'm concerned that this means that the tracking is not setup correctly. Since both of these are experiments on our landing page/visible on many different pages, I would expect the number of entrants to track closely to the total number of sessions that we see from Google Analytics.

Answers (7)

Answers (7)

Nikhil_Bisne 15-10-2015

Hi,

 

Can you please let us know the answers to my previous question? It'll help speed up finding a resolution to your queries.

 

Thanks

Nikhil

picklespug 15-10-2015

Customer returning is defined as target-global-mbox <company>_customer equals Y

This is our setup for returning customers, so it is just this mbox parameter we are trying to use.

Our global mbox is setup right as far as I know, how would I find if it is not?

Nikhil_Bisne 15-10-2015

Okay. Is the Global Mbox setup properly and referenced correctly? What is the exact rule defined for the audience you've setup ? Is it returning customers and the Mbox parameter? Make sure you've setup this audience according to the steps mentioned on this document.

 

Thanks

Nikhil

picklespug 15-10-2015

We're using Standard. I've tried using a range of the audiences. Returning visitors are a predefined audience. Customer returning is defined as target-global-mbox <company>_customer equals Y

Nikhil_Bisne 15-10-2015

Are you using Target Standard/Premium or Classic. Also if you're Standard how you are counting returning visitors? Are you using Audiences? If you're using Target Classic which report type are you using and how have you defined the segment to count returning visitors?

 

Thanks

Nikhil

picklespug 15-10-2015

Google analytics for the same time period indicates that we should have had 25k returning customers. The experiment was a simple A/B that swapped out the html offer in the upper right of our landing page. The offer is also available throughout the site on search results pages and product category pages.

Nikhil_Bisne 15-10-2015

What is the entry count you were expecting? Also what type of tests have setup and how ? If you can provide some details it'll help solve your query faster.

 

Thanks

Nikhil