Am I wrong for not wanting to have sex while pregnant?

So im 11 weeks 4 days pregnant. Since ive been pregnant i havent been interested in sex at all. In exhausted nauseous and just feel like crap overall. Well my boyfriend gives me attitude about it. He might not notice but he does. And then says its ok and he understands why i dont want to. And now as we are trying to go to bed he asks me if im having sex with someone else. Like am I seriously that bad of a girlfriend for not wanting to have sex. That not he thinks im cheating on him.... i cant believe he would even think that. Am I wrong to be hurt and upset by this?