The cold isn't the problem.
You have to be sure that there is no water trapped in (e.g. rudders), because ice needs more volume than water. Well you know this from beer bottles in freezers...
Apart from that there is more exposure to UV radiation, rain and strong wind, hence your boat and equipment suffers simply more. If you have a good tarp, you can minimise this.

Cheers,

Klaus