... why not take a piece of hose, cut it so it slips over the bungee & then tape it up with some good rigging tape?
Or, what about mounting some kind of small rubber piece on the backside of the rudder blade, exactly where it would hit the aluminum tube, as a kind of shock absorber?