How do others think about "productionizing" winning Target Premium tests?

Our technology team is uncomfortable with letting things "live" in Target perpetually, even though that is the best way to let the models run in the background and continually learn and provide value.  What have other companies done?  Is anyone else uncomfortable with letting Target drive what shows up on their website in a more permanent way?  What solutions have you deployed?
Open to any thoughts or advice!
Thanks!