I went over his house.. is it my fault that this happened to me?

So I was seeing this guy, we texted for about a month and met up on April 10. Since then up until today we seen each other about 3 times. We instantly connected, never a dull moment. Felt like we knew each other for years. So I went to his house for the first time Saturday to smoke hookah(my idea,I’m the main one who smokes and I smoke late night). Plus, i was friends with his sister who he stays. And also had college classes with her AND their mom. So I went to his house around 8:30. I was suppose to go over earlier, but due to my car breaking down, time got pushed back and he came to get me. So started watching a movie, cuddle a little bit, not full on. I didn’t mind cuddling, because I felt a connection. I accidentally fell asleep and so did he. So we woke up in the middle of the night, went back to watch a movie and he started getting handsy. I kept telling him to chill, he knew I move slow. We hadn’t even kissed. I did think in my head about sex, even us hanging out in public, but never acted on it. He kept trying to kiss on me, I said stop. Touch my breast, I moved his hand. Kept pulling on me(I pretended I was sleep), kept asking for a kiss even though he knew I was halfway sleep. Then he said “ I wanna give you head, that’s it” …I told him I had to leave a little while after because of my dog(not true). I text him the next day, said I didn’t like that and that the situation rubbed me the wrong way. I figured it was my fault because I did go over there. He apologized saying he was “horny”. I was just in shock… I’ve stayed over guys houses before several times who I dated without them trying me at all. We text for a few days after that but I really started thinking about it and everything he said made me cringe. He sent me a long message and blocked me on everything.. even stuff we were friends on so that weirded me out too. But am I at fault? I feel like I should take accountability, because the situation that I put myself in. I went over there late at night, so I guess it’s only right for him to assume it was going to lead to something else