What should I have done?

So me and my boyfriend have had a lot of sex for the past 2 years we’ve been dating, everything was fine until this morning where he wanted to have sex but I’m not really in the mood. He was touching me in all the places he knew would get me wet, but I still wasn’t in the mood (mind you; we had sex last night but I stopped it because I wasn’t feeling it anymore) he kept asking if it was okay for him to keep going, asking for my permission and I said yes out of feeling bad we didn’t finish last night. But as we’re doing it I just don’t feel in the mood so I just lay there. He finishes and again asks if I’m okay- he gets no response and he goes to sleep. I felt icky but I could’ve told him no I don’t want to have sex... he’s the first person I’ve had sex with and I don’t want him getting angry that I’m leaving him sexually frustrated. I’m normally too shy to speak up.

What should I have done? Am I in the wrong?