When "there's something stuck to the rudder", chances are that it's holding the tiller extension.
Don't ask...
A cotter pin, nut or bolt in your tramp may have been put there on purpose. When you get to this conclusion, the race will have started already. It doesn't happen twice.