Yes You can't delete any rules, elements, extensions, etc without disabling them first.. but if you disable, then push all those changes up to prod, all the tracking logic will be gone.
IF you were planning on keeping the property, you could then delete the disabled items, but since you want it ...