this is a pretty common problem to cats. Perform a search on this forum for humming and you'll find a lot of advice. You are pretty much correct in your guess and while shaving the trailing edge will help, it's more important to chamfer one side slightly more than the other. This creates a tiny imbalance that will keep the rudders from setting up an oscillation.
