My bf touched me when he thought I was asleep...

So early this morning I slightly woke up to my bf grabbing my boobs. He had his hand under my shirt and was playing with them and touching my nipples. I was barely awake, and not in the mood so I just tried to ignore it and go back to sleep. Then a bit later I slightly woke up again and his hand was in my pants, over my panties, rubbing me and touching me. He obviously thought I was sleeping because when I moved a little, he paused, waited a minute and proceeded. I don’t know why I didn’t say anything, but I have been raped and sexually assaulted in the past so I guess I just froze. He eventually slipped his hand under my panties and start playing with my clit, but his alarm when off shortly after so he stopped there. I didn’t move at all or open my eyes, so he had to think I was asleep the whole time. Idk I just feel weird about the whole thing. Something similar happened one other time, but it wasn’t this long and he never went under my panties.