Hmmmm.... not sure that there's a native way to do this.
However, you can attach an approval route to the milestone task. Since the Project Owner's Manager isnt one of the approver options, you could assign the milestone task to the Project Owner and then set the approval route to the task owner's manager.
