Is this okay???

I've been seeing a man for about 2 months and last night I woke up to him having sex with me.. while I didn't stop him for a little bit I did eventually, as I started to feel really upset realising what he'd actually done. At first I kind of liked it but then it also triggered things of my childhood abuse and I felt really uncomfortable. After he stopped he kissed my shoulder, and said let's get some sleep and just rolled over. Then I was really annoyed cause I couldn't get back to sleep then. I don't know if it's just me being overly sensitive or if he was completely wrong to do this? And come to think of it, I think he may have done things before as I've woken up noticing some signs after staying with him ? I'm so confused