The spinnaker gets easier with time, the fabric starts out pretty stiff. As others have mentioned, put a spacer in your retrieval line so that all the patches aren't entering at the same time.
Is the halyard diameter the real source of the problem? Consider your halyard ring and how the line/knots are oriented. Be consistent on how you connect it to the main. While unhooking are you forcing the mast to rotate?