Feeling unwanted?

Most every relationship I've been in has been at least slightly sexually abusive. I'm used to boys only wanting me for sex and not actually caring about me, and manipulating me into doing sexual things. Now I have this wonderful boyfriend, who is very kind to me and isn't really interested in sex. But because he's not interested in sex, I feel like he's not attracted to me and that he's going to leave me for someone else. I don't know what to do, has anyone else felt this way?