No need to grind the tops off. Drill through the center of them with a drill bit one size smaller than the hole (this way you don't risk enlarging the rivet holes). This makes the interior wall of the rivet very thin. Then punch them through - should be pretty easy.