Complete waste?

So, my s/o and I have been seeing each other for 4 months now but we haven't given each other titles of bf/gf. We have agreed to be exclusive and only see an dbe with each other. The first month in, he told me he wasn't ready for a serious relationship yet and I figured it was fine because we barely knew each other yet. Throughout our time together we've met each other's friends and parents, gone on dates, have had sex, and done everything else in between.

But he works a 6am-6pm mon-friday job so we only see each other once a week.

Lately, i have noticed he hasn't been very eager to hang out. Like on his free day usually sunday, we would hang out no problem. The past 3 or 4 weeks ill bring up hanging out and he either dodges the message and waits last minute to confirm plans, reschedules on the day we r to hang out, or if i dont ask him we dont see each other. He always plans the dates but i plan when usually. When we do hang out we have a good time, r happy, he puts in lots of effort, and im satisfied. But the 6 days i dont see him i struggle to feel happy on this complicated "thing" we are in.

Am i wasting my time? Should I leave orrr bring it up to see where he stands first? I mean we r literally adults I'm not in high school anymore wanting immature relationships.