Ability to limit Custom Field visibility / availability based on Group

It would be great to have the ability to limit the Custom Fields to users (including Group Admin) to use / access by Groups. This will improve the user's experience and allow them to only see Custom Fields that are shared with them and what they see when building reports as well.

Similar to not being able to deactivate custom fields as we get more groups report creation is becoming frustrating for users.