Am i in the wrong

so me and my boyfriend have kind of been arguing a lot this week over the same thing. on monday we were both free, didn’t hang out the day before so i wanted to hang out with him and he said no and when i asked he said “because i don’t want to” not really giving me a reason and it cause an issue between us. i told him i wouldn’t have gotten upset if he was like no i don’t feel like hanging out today but we can hang out this day instead and his response to that was “well i don’t know when i’m going to be free” and i was like okay fine since you’re so busy i’m not going to make plans with you this week since you’re the busier person if you want to hang out you make the plans and i told him wednesday was my free day. then today rolled around and he wanted to come over and have sex and it bothered me that that’s what he wanted to do instead of actually hanging out

sorry long read, but does it seem i have a valid point or am i just fighting for no reason. if i’m overreacting i’ll apologize, but i just want him to make an effort