Opinions please!!

Hi! So I’m 24 years old and I recently decided to date. I have never had a bf in my life and new at this. I wasn’t like this back when I was in high school, I used to mess around but not anymore. I grew up and matured more and realized that I want a guy in my life. So I met this guy who came up to me. I’m transferring to college out of state so I told him that I just want a casual fuck and if it leads to more then that’s fine. But for him he wants to date. So the first time I met him, we had sex and the second time and the third time. What hurt me the most was that EVERTTIME we had sex, he fell asleep right after we fucked, didn’t say bye or walked me out. As he was holding my hand as he was napping, he wakes up, and turns off his music and told me to lock the door when I go out. Is that a red flag? Or am I exaggerating? And another thing that kinda hurt me a bit is that he knew it was my bday but didn’t even call or text to wish me a happy bday? So do y’all think that I shouldn’t date this guy? He says he wants to date but does that mean he only wants “sex?”