Long distance relationship

So I recently started college and left my boyfriend in my hometown which two hours away from where I am. For I while I would go down every weekend but now it's getting hard. He says he's putting in effort to see me but the only time he comes is if friends of his come with him which has only been twice in the past 3 months. He doesn't understand why I'm upset. I love him. I really really do. The though of leaving him hurts me. But this is getting hard and I'm getting inpatient. He's suppose to move in with me next year. But I'm started to feel as if I'm in over my head. We've been together for a year and a half and he's the only person I have ever been with. Are these bad signs and or deal breakers?