Hi Peter,
I do believe you have gone the wrong way.
And if you go on the outside, you are again going the wrong way. It is a longer distance and you WILL get your butt kicked.
I have done quite a number of yacht deliveries down the coast and the only way to safely and comfortably navigate past the big capes is to take the Atlantic Intracoastal Waterway to Beaufort, NC. That is a shorter distance and in safe, navigable waters.
Outside you will be experiencing the clash between two ocean currents that meet off Hatteras and really cause havoc.
Several times, while restocking in Beaufort a weather torn sailboat would come with everything on the boat a mess and sails torn, etc. Hate to think how many did not make it at all.
Good luck,
Rick