Would u be offended/upset?

I'm 4 weeks 3 days pregnant and me and my boyfriend have been into it because he said he will never have sex with me without a condom again! He also said that having sex now since I'm pregnant is "weird".. I've told him multiple times that it's healthy for the baby for us to have sex, and whether it's witha condom or not it won't change anything. I'm honestly offended he would even say that to me! Am I wrong for feeling this way? Btw I'm 17 & he's 18 (years old).