Adding external workers to production

Hi,  We work with a lot of freelancers and sometimes need them added to the environment as either workers or reviewers.  We also run SSO for our internal users and this tends to interfere with the external users access as it keeps trying to get them to log in use SSO then rejects them because they are not on the list for SSO.  Would be grateful for any suggestions on how to work around this.