I think part of this sport is attrition, and that's not necessarily a bad thing. Singlehanded I start falling apart at the lower mid teens for wind speed, (knots). Two up I can handle a lot more.
Its up to every sailor to determine what their limits are, and that shouldn't change. There's plenty of conditions where I have just gone, "nope, I ain't doin' it". Sure I lost some positions, but that's how it goes.