Allow someone with Manage permission to remove just ONE inherited permission on an object (currently the only option is to remove ALL)

I've searched endlessly but don't think this topic is out there yet. I would like a person with Manage permission on an object to remove just ONE inherited permission on the object. For example: A document that you wish to limit access to. You may not want to remove ALL inherited permissions because some people with inherited permissions do require access. This is just one idea of many with the theme "We need more customization and privacy setting options at every level."