Fallen in Love

Has anyone ever fallen in love with someone with sociopathic characteristics? Like they have trouble feeling much of anything. I think I might be... and it's starting to hurt 😞 We've seeing each other for a few months... but he hasn't asked me to be his girlfriend because he says once the lable is attached, he starts to stress out and it ruins the relationship for him (he's not using this as a stupid excuse, he has anxiety issues and I believe him). But I brought up how the fact that his inability to be ready for a relationship has started to hurt me. It's just the thought that it seems to me that I'm not enough to make him love me. He says that he truly cares for me and that he respects me... and that makes me special to him because is rare for gim to feel that. 
But he's leaving for graduate school (possibly out of state) and I feel like it's going to break my heart. 
Has anyone been through anytging like this?