Yes, the previous owner had changed cams by drilling out the rivets. The hole in the rudder casting has been enlarged as a result and I thought that might be related to cam sitting too far back. I don't know what one would use to fill in the aluminum and redrill or even if that is possible.
I'll tighten up the derlin screw and see if that helps. Thanks.