Removed condom?!

Okay so this was like two years ago, but i saw a post on here and it got me thinking... I’ve been with my boyfriend for three years. During the first year we got suuuuper drunk. And had sex, it started off with a condom. And then next thing I knew it was gone. He told me he took it off because it was “ annoying” I was very upset and we fought and blah blah. He hasn’t done something like that since. Is that rape? Or just drunk brain lol Someone on here said that would be?! What do you all think?