If you are talking about "tracked" fields (whenever a field's value is changed, the system notes that change in the object's update stream), then the answer is "no."
The function of tracked fields is to enable auditing. If users - even if limited to admins only - had the ability to delete or edit these entries, that would weaken the integrity of the platform because there's no guarantee that someone can't go back and cover their tracks by changing or removing an entry. So even if a user has good intentions (only fixed a typo in the field and they don't want to clutter the update stream), allowing them to edit or delete the system-generated update would mean the audit history cannot be trusted and defeats the purpose of tracking those fields.
If you like my content, please take a moment to view and vote on my Idea Requests: https://tinyurl.com/4rbpr7hf