We used to experience this. Have you tried creating a blank page with the same URL and publishing it? Then, you should be able to deactivate it and delete it properly. We called them ghost pages.