RTP Auto Tune in an AB Test? | Community
Skip to main content
Jessica_Ruffalo
Jessica_Ruffalo
Level 4
October 7, 2015
Question

RTP Auto Tune in an AB Test?

  • October 7, 2015
  • 2 replies
  • 1721 views

Does anyone know how long 'auto-tune' actually runs the test?  I'm hesitant to select it as there isn't a set time to run the test before auto-tune takes over and starts displaying the winning campaign.

From the Product Docs: Selecting Auto-Tune allows the RTP platform to automatically recognize the better performing split test campaign and continues with the highest converting campaign, while pausing the others.

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

2 replies

Josh_Hill13
Josh_Hill13
Level 10
October 7, 2015

I suspect in this case that you need to setup a reminder to look at the data after however many days.

This will depend on the site traffic to achieve whatever confidence level Marketo has set as default (prob 95%).

AB Test Your RTP Campaign - Marketo Docs - Product Docs

I recall some other products with auto-tune will start to display the most likely winner within a couple of days if there is enough data, for example, LinkedIn AB tests do this.

A
Anonymous
October 7, 2015

Hi Jessica:

RTP will run the test until it has a statistically significant difference.  Once it reaches that point it will recommend the winner of the test.  The duration is determined by the results it receives

Terms & ConditionsAccessibility statement

Loading footer...