Should I Be Concerned?

Taylor
My boyfriend moved back home for summer break and is only a two to three hour drive away. He refuses to have me drive up for the weekend because he doesn't think it's fair to me where he was the one who decided to move back home. He doesn't want to talk on the phone or video chat and his texts haven't been overly friendly and there is always a way to cause an argument. If I tell him I miss him he says he misses me too but it's not fair for me to make him feel guilty for being so far away. He rarely holds a positive conversation with me anymore either. 
Is this possibly approaching an end? We're really happy when we're actually together but because that's become so rare I'm not sure we'll end well and I'm just so freaking confused