The reason it seems hard to flip back up is the difference in leverage. If you look at the length of the rudder and apply the distance vs force factor you would see that it really dosen't take much to rotate the cams. The best thing to have is a cat key that has the hook for the rudder cams. This makes it easier to rotate the cams when they have inadvertently rotated (especially when you are out on the water)
Clayton