We remove them from all active proofs. You have to find that option in the contacts section. That leaves their approval on all old proofs, and their comments on all proofs, but doesn't hold up anything by leaving them on with decisions still pending.
