It sounds stupid, but make sure the rudders are installed on the proper sides.

The tiller arms angle in toward the center of the boat.

If that's not the problem, maybe the rudders aren't aligned properly. The trailing edge of the rudders should be about 1/8" further apart than the leading edges.