That's correct, you cannot simply send unsegmented info to Facebook. As this integration is one way.
Your suggestion is right here: to create another segment in AAM of those who opted out.
Then while defining your Audience in FB for a particular campaign, you can use AND NOT or Exclude condition to suppress the second segment. Not really sure on this, but I'd recommend to test this out, and let us know here.