You were on stbd tack, so you had the right of way the entire time. He only had mark room WRT the left gate mark - and then only room to sail to the mark and his proper course when rounding (no tactical rounding).
But you did the right thing - except for saying "protest" and filling out the form.