App Builder Headless React SPA

We are building an App Builder project utilizing a headless React single page application and because its single page routing occurs client side which causes a 404 error when the page is refreshed because the server does not know the route. Typically this is handled by changing the server config to always point to the index file of the React app but how do we handle this with App Builder?