Currently we can add fields to the Home and Summary tab via the layout template, however, those fields are only visible to the person assigned to the object. In general when a customization is added to a layout template everyone with that layout template can see the customizations and I don't believe this particular functionality should be any different.
Make addition or removal of fields on Home and Summary visible to everyone not just the person assigned to the object.