Hi Zeke,
Welcome to the Adobe Analytics Community!
I can see the Report Builder group on my company, could you check that out again probably in a different browser? It would be a Pre-defined group. Yes, to download RB you would have to be a part of the RB access group. If you are still not seeing the group let me know.
I hope that helps.
Tanmay