If you are able to update / edit your templates, it appears that when you are in the template view you can select the "i" icon and view the properties of that template. There you can upload a new icon.
We are on 6.2 and I am having trouble with updating that icon. I can get it to load, but then it spins and does not save. That could be a permission issue for me however.