Referrers, which I assume you mean to be referrers from 3rd party sites, only make sense when used with Entry Pages, which are the first pages that people see in their visit to your website.
So you can break down Entry Pages by Referrers (or Referring Domains, if you don't need the detailed referral URLs), with the Visits metric to get your report.