When you say you published the component did you do that using a package? If you want to publish a delete of a JSP file like that you have to do it via a package and not normal replication. If you create a CRX package, put your component in the package, build it, and then publish the package it will delete your JSP.