I have a slight problem when trying to attach 2 separate curves, I've got 2 curves which meet in the middle when I go to attach and with whichever option selected I always get this additional curve that goes through the middle. I just simply want to attach curves at the point they meet in the middle. Any suggestions, what's the problem?

I've deleted history and frozen transforms beforehand.
After attaching when I try to move them this happens:
