I suppose the short answer is yes it will have some effect on the speed of the hull through the water.

Realistically though, the effects would be so negligible when compared to going the wrong way up a work or having a wineglass in the spinnaker or even having half a millimetre more or less prebend in your mast.

Happy sailing!