It depends on the boat, how much gear(weight), how many people(weight), and water conditions.
You could load a Nacra 6.0 with 100-200lbs of extra gear and it's handling would suffer a little. Put 200lbs of extra gear on a Hobie 16 and it becomes a slug.
Towing is also detrimental to boat handling. There is no free lunch.