I am facing the similar issue. I am trying to open a XDP file through a servlet and got the same result.
Did you find the solution for the issue (Firefox opens XDP file in new window)? Please update. It will really help a lot. Appreciate and Thank you.