there is no way to limit segments/calculated metrics for a reportsuite. they appear as soon as you have access to the items (either by creating or sharing to you).
this is one of the reason people both recommend using VRS and use a proper naming and tagging of the elements. having this setup makes it easy to find the desired items.