worried over nothing?

My boyfriend and I have had sparks for 4 years now and I'm so in love with him & he says he is with me as well. However, I deal with bad anxiety and often I worry he's bored or wants to leave. I know he probably doesn't and it's just me worrying but sometimes I worry myself to the point of tears & being sick. When I talk to him about it he says it makes him upset when I feel that way because he would never leave so I don't really want to talk to him about it because I don't want him to be upset. Does anyone else deal with this? If so, what do you do to help?