Ability to set permissions at the queue topic / topic group level

Many of our request queues have queue topics and/or topic groups associated with them. Not all of these are relevant to certain users; it would be helpful to be able to set permissions at the queue topic and/or topic group level.

Currently we are only able to set these at the request queue level, which is very restrictive and dictates the way we structure our request queues.