Am I being crazy

Okay so me and my man have been together almost 3 years. Usually he hangs out with his friends every weekend all weekend. He works full time so we don’t spend time on the weekdays except when we see each other at church. Today I asked if he wanted to do something he said yeah what I mentioned a ton of stuff to do. I town has nothing so I mention stuff that’s around 25 mins away and he says he is tired and doesn’t want to drive far and so we go eat and then I go home. Like 10 minutes later he’s hanging out with his friend and is going about an hour away to go buy stuff and I was like I thought you were tired and didn’t want to do anything or a lot of driving and he said “were done”. Like seriously dude. Mind you i have been asking him for weeks to please try to spend more time with me. I’m just upset and I don’t know what to do. Am I in the wrong. I’m so conflicted.