No, but it does matter if they were rounding to port or starboard (port roundings are the norm in the states unless it's a gate).

The boat approaching a starboard rounded gate buoy on port definitely has inside overlap and you do owe him room. If you draw a line sqaure off your stern, you'll see that the port tacker will usually easily fall within this line. It's a tough situation, especially if you have a leeward boat who's not willing or able to heed. The best thing you could have done in that situation, is to see the port boat coming, ask for additional room from the leeward boat, and try to avoid contact. If contact is had and you have done all these things, you will not be at fault. You would then need to protest the leeward boat for not giving you room and the port tacker for not avoiding contact.