We've discovered the following:
1. AEM does NOT work on Azure App Services, or at least we are unable to get it to work.
2. AEM does work in a hosted VM.
Next, we're going to try securing the Author and publisher instances with Azure AD To see if that works. Will update this thread with updates.