Audiences don't really work that way. But as a workaround to achieve what you are describing, you could use Services instead. Look at the "Example: Updating multiple subscription statuses from a file" on this page Subscription Services
You can retrieve current subscribers within the workflow (similar to what you would do with an audience).
Thanks,
Pulkit