Is this rape?

So twice now I've woken up in pain and almost throwing up while pushing my husband off me. Both times I was laying on my side and his penis was in my ass. It was between 3 and 4 in the morning both times. And as soon as I start yelling at him and telling him that's not ok, he tells me it's my fault because while I was sleeping I moved my ass closer to him. Mind you I've always slept on my side in the fetal position. Or he'll tell me that I must've been having a weird dream because I was making noise and put my hand near his penis in my sleep. So apparently me doing that gives him the ok to start having sex with me when I wasn't even awake? I'm just confused and I feel gross and like it's my fault