I would recommend to raise a support ticket, however I suspect that GLB and other 3D formats are not officially supported for delivery with Dynamic Media Classic.
If you have your own CDN layer infront of AEM DAM you may be better to simply expose these types of files directly as DM would only be...