You don't mention whether the jib was still out, or whether you were sailing with it. Even unsheeted, the jib would tend to sail the boat downwind and keep it sailing downwind without the main to add balance. So, furling the jib would have helped alot IMO.