Am I crazy for feeling this way?

So my husband for some odd reason felt the need to tell me last night that he masturbated and I kind of got aggravated because I was right there in the living room not doing anything, so you know he could’ve come and got me and we could’ve had sex, okay. Anyways, I don’t even remember how it got brought up but he point blank told me he imagines other women when he masturbates. I don’t know why but it just really bothered me and made me wonder if he does that when we have sex. Mind you, I was a lot smaller when we got together and over the years I’ve put on a couple pounds so it makes me feel insecure and like he’s not attracted me in the least anymore. Mainly because he never even tried to have sex and he used to all the time and his excuse is “it’s not important anymore, I have other things to worry about”... It just kills any bit of self confidence I had... am I crazy for feeling like this?