I'm not so sure that's a problem. When you are pacing against another sailboat, the number of variables must compound dramatically, because you are dealing with the variables concerning both boats and the relative skills of the skippers.

You still won't necessarily know whether it's a wind change or a trim change causing the speed difference, but at least you will know that it is something to do with your own boat and not the other boat.