Max Q is really the problem. Felix is jumping at probably the best point-much higher and you have to worry about re-entry trajectories. Jumping out of a moving spacecraft isn't trivial either, but that depends on the altitude and the airspeed-an escape pod probably makes more real-world sense.

Really the Apollo guys knew what they were doing when they went for the capsule design. Carrying wings into space is a bit silly, but the Air Force seems to think splashing down in the ocean is a bad idea too.