Just my view, from personal experience:
I've been sailing my Stealth in about equal amounts in the two configurations. I don't actually feel that there is much of a difference between them.
Around the course I'm possibly faster in sloop setup. But 'in a straight line' the two setups are the same. I'm winning races in both configs, and battling with the same boats during each race.
The freedom this gives me is fantastic, and is something I've never experienced with any other boat in more than 30years. To be able to DEFINATELY go sailing on a particular day and not have to chase around for a crew or worry about whether it'll be 'too windy' to sail one-up is an absolute joy.
THAT is what attracted me to the F16 class and what should be the real reason for anyone buying one

Racing on a first over the line basis in either configuration is therefore in my opinion perfectly fair, whatever the 'expert' handicappers might say.