20.3 A boat moving astern by backing a sail shall keep clear of one that is not.
The key phrase there is "by backing a sail." If you can back up without backing a sail, as can be done with a lot of boats, you still have rights over the boats behind you, because they are still considered overtaking boats.
Am I wrong? I can back up my boat forever with the sail just loose and weathervaning.