I am not trying to be glib, but fixing that kind of stuff does not make you go any faster.
Aesthetically it looks bad, I will agree, and I would probably try and get some off as well. But in the big scheme, your time would be better spent fairing the hulls, rudders, etc. Also replacing running rigging, lines etc would be more beneficial to getting the boat ready for the water. The rubbing near the tang can be lessoned by using rubber tape around the fittings.
Anyway, good luck with the boat!!