Correct, if you remove the field you will lose all the historical data. I'd suggest making another section at the bottom of the form, e.g. "Archived fields" and put your field in there. Make the section visible to all but editable by only admins, and that should make sure no one is able to add or change any values.