What to do help!

So my boyfriend and me are expecting a baby and I have been working and he's been working we don't live together because we are young but I have been working 6 days a week trying to get enough money for the baby and when it was just him working he was fine and he would hang out and he was never mad at me but I started working to support us and the baby and now he's like I'm going to come over and I'll tell him I work and he's like k bye then ? And I'm like we'll I'm off Friday do you want to hang out then and he's like naw I'm good like wth? What did I do what am I doing wrong