Red flag right?

Ok y'all so me and my boyfriend been dating for 2 months, we live like 30 mins away from each other, I live with my parents and he lives with his grandma, brother, etc etc. So we see each other a few times a week when I go to the gym cuz the gym is 5-8 mins walking from his house and we spend a little bit of time with each other outside, very little. We spend time with each other on the phone every day too and I'm not able to spend more time with him cuz my parents are very strict, meaning I can't go have dates with him, and his grandma doesn't allow people there too. So today his grandma is out for a while and he wants me to come over to his place cuz "he wants to cuddle" and spend more time with me since we only spend so little whenever I go to the gym. But he's mad because I don't wanna go over there to his place, I told him I can go to the gym today and see him for a little bit outside but not going to his place and he's saying I don't understand because he wants to spend more time with me like that. Plus next month is my last semester in college which will be online Mon-fri, class from morning all the way at the end of the day, and that means I'll be paying just to go Saturday and Sunday to the gym so I will cancel the membership, meaning we won't be able to see each other for a good while, and he doesn't like just being on the phone, mind you, all his relationships before were long distance. But he doesn't understand that since it's my last semester at college I need to focus really hard so ofc I need to stay home. And I will transfer to another college in January for me to finish the bachelor's, Do you think it's a red flag? The only things we did with each other was hug and kiss. And I don't have a problem being on the phone with him cuz I'm happy just seeing and talking to him, things doesn't always have to be physical.