Boyfriend says I sexually assaulted him

Last night me and my boyfriend had an argument, and then we were going to have make up sex. Just before having sex he started complaining about having to use a condom and I ignored it because he knows I want to use one as I rather not take birth control. Do after we had sex he said "I didn't want to do this" and I was very surprised and said "What? Didn't you want to have sex? Did you not consent to it?" and he said "no", so I started apologising sincerely for not picking up the signs and felt absolutely disgusting.

After all that he said that he did want to have sex, but that he hadn't consented on using a condom, so therefore I had sexually assaulted him. I don't know if I'm wrong, but I git really upset. I don't think you can not consent to protection, unless you are trying to conceive. We had an argument again where I said I think he's selfish for wanting me to go through the risks of birth control (which I always had bad side effects from) when we can just use a condom which has no risks or side effects at all, other than making sex less pleasurable for him.

Then he said he thinks we shouldn't use any form of birth control and that also upset me because he knows I don't want a child right now, and I said that is also selfish because I think that a child should preferably be planned and wished for, and he just said it would be planned and wished for by him. It was impossible to reason with him and I just got more and more upset, so we fell asleep upset with each other. Did I sexually assault him for making him wear a condom?

Also, we're 27 and have been together for 7 years, if that matters. We have had discussions about birth control and children before and he has agreed to use a condom so that I don't have to take any birth control pills or such, until I'm ready to have children.