Expand my Community achievements bar.

[AT Community Q&A Coffee Break] 7/8: Rob Hornick, Adobe Target Product Manager

Avatar

Administrator

Join us for our next Adobe Target Community Q&A Coffee Break

taking place Wednesday, July 8th @ 10am PDT

--> REGISTER NOW <-- 

We'll be joined by Rob Hornick aka @Rob_Hornick, Senior Adobe Target Product Manager, who will be signed in here to the Adobe Target Community to chat directly with you on this thread about your Adobe Target questions pertaining to his areas of expertise:

  • Personalization
  • Machine Learning & Artificial Intelligence 
  • Recommendations
  • Auto-Allocate
  • Auto-Target
  • Automated Personalization 

Want us to send you a calendar invitation so you don’t forget? Register now to receive a reminder!

A NOTE FROM NEXT WEEK'S COMMUNITY Q&A COFFEE BREAK EXPERT, ROB HORNICK 

 

REQUIREMENTS TO PARTICIPATE 

  • Must be signed in to the Community during the 1-hour period
  • Must post a Question about Adobe Target
  • THAT'S IT!  *(think of this as the Adobe Target Community equivalent of an AMA, (“Ask Me Anything”), and bring your best speed-typing game)

INSTRUCTIONS 

  • Click the blue “Reply” button at the bottom right corner of this post
  • Begin your Question with @Rob_Hornick 
  • When exchanging messages with Rob about your specific question, be sure to use the editor’s "QUOTE" button, which will indicate which post you're replying to, and will help contain your conversation with Rob

QUOTE BUTTON.png

 

Rob Hornick Headshot.jpg

 

 

 

 

Rob Hornick is the Senior Product Manager for Machine Learning and Personalization with Adobe Target, based in San Francisco. Rob is energized by both building tools to personalize digital experiences and putting advances in machine learning into marketers’ hands. Prior to joining Adobe, Rob was a Manager with Accenture Digital where he helped marketers optimize their processes and technology.

 

Curious about what an Adobe Target Community Q&A Coffee Break looks like? Check out the thread from our last break with Ram Parthasarathy, Principal Product Manager for Adobe...

Topics

Topics help categorize Community content and increase your ability to discover relevant content.

26 Replies

Avatar

Employee

Hi @Rob_Hornick, this question was posted in the community by @dsu50:

 

Do Adobe Target Auto-Target and Auto-Allocate options use Bayesian or frequentist statistics? Is there a documentation that describes the statistical methods these options use? 

Avatar

Level 2

@surebee wrote:

Hi @Rob_Hornick, this question was posted in the community by @dsu50:

 

Do Adobe Target Auto-Target and Auto-Allocate options use Bayesian or frequentist statistics? Is there a documentation that describes the statistical methods these options use? 


Hi @dsu50 . In both Auto-Allocate and Auto-Target we start with a prior probability of conversion for each experience and then update the estimate over time, so both use Bayesian methods. More info about Auto-Allocate is available here: https://docs.adobe.com/content/help/en/target/using/activities/auto-allocate/automated-traffic-alloc...

More info about Auto-Target's model is available here (note the same model powers Automated Personalization): https://docs.adobe.com/content/help/en/target/using/activities/automated-personalization/automated-p... 

Avatar

Administrator

Hi @Rob_Hornick, thanks for this insightful coffee break! This Question was previously posted in the Community by @petero52240340 :  

 

I know the general guidelines on the Adobe site around Auto Target are;

When Conversion is your success metric: 1,000 visits and at least 50 conversions per day per experience, and in addition the activity must have at least 7,000 visits and 350 conversions.

How rigid are these, i.e. if I have roughly 960 visits a day and 40 / 35 conversions, is this still viable to run and it will take longer to achieve confidence? Does this work in the same way for say 800 visits? 

I would like to try auto targeting but volume is an issue so I wanted to try and see if we could still run auto targetting.

Avatar

Level 2

@Amelia_Waliany wrote:

Hi @Rob_Hornick, thanks for this insightful coffee break! This Question was previously posted in the Community by @petero52240340 :  

 

I know the general guidelines on the Adobe site around Auto Target are;

When Conversion is your success metric: 1,000 visits and at least 50 conversions per day per experience, and in addition the activity must have at least 7,000 visits and 350 conversions.

How rigid are these, i.e. if I have roughly 960 visits a day and 40 / 35 conversions, is this still viable to run and it will take longer to achieve confidence? Does this work in the same way for say 800 visits? 

I would like to try auto targeting but volume is an issue so I wanted to try and see if we could still run auto targetting.


Hi @petero52240340, thanks for your question. It's still possible to create an Auto-Target activity with less traffic than the recommended guidelines. However, it will take additional time for Adobe Target to build predictive models, and the predictive models may be lower-quality. Some quick tips to get better performance from Auto-Target activities with less traffic:

  • Direct less traffic (10%) to the control option. This ensures that plenty of traffic is available for exploration and exploitation. (The tradeoff is you may have a less accurate measure of the overall activity's lift.)
  • Use fewer, more distinctive experiences. For example, use 3 very unique, distinct experiences (e.g. headline and hero image and product change) rather than 10 experiences with small differences (e.g. changed background color of product image.)
  • Use a conversion metric rather than an engagement or revenue metric. Binary conversion metrics are easier to model in low traffic scenarios.

Avatar

Administrator

Hi @Rob_Hornick, this Question was previously posted in the Community by @Saif :

 

I want to use two different recommendations design in the same recommendations activity and divide the traffic between the 2 designs making it a 50/50 split.

This idea makes it a combination of recommendations and A/B test.

Since recommendations only allows one version apart from control, we are not able to add more designs as different versions in the same activity.

Please let me know how we can achieve something like this

@ryanr79035901

Avatar

Level 2

@Amelia_Waliany wrote:

Hi @Rob_Hornick, this Question was previously posted in the Community by @Saif :

 

I want to use two different recommendations design in the same recommendations activity and divide the traffic between the 2 designs making it a 50/50 split.

This idea makes it a combination of recommendations and A/B test.

Since recommendations only allows one version apart from control, we are not able to add more designs as different versions in the same activity.

Please let me know how we can achieve something like this

@ryanr79035901


Hi @Saif , you have two options:

  1. Set up your test as an A/B test activity and then insert Recommendations offers into each variant. This allows you to test a number of different design/algorithm combinations. For example, you could set up a test with 4 variations based on the number of items to display (4 or 6 items) and the algorithm to use (recently viewed or top sellers). You can then specify the exact traffic split you want (even or otherwise). For more on this option, see: https://docs.adobe.com/content/help/en/target/using/recommendations/recommendations-as-an-offer.html 
  2. To accomplish your goal in a Recommendations activity, select a single Criteria, then select multiple Designs during the "Select a Design template" section of the activity creation workflow before continuing. Recommendations activities allow you to test either multiple Criteria or multiple Designs, but not both at the same time. Recommendations activities also force an even traffic split between all non-control variations. For more on this option, see: https://docs.adobe.com/content/help/en/target/using/recommendations/recommendations-activity/create-...