Husband issues

So I have been working from home (not by choice because we can find a new daycare we recently moved to a new area) and I’m going crazy with my 1 year old all day long. I love him to death but I need adult interaction and on top of it I am very sick I have a picc line and I have hypermesis and I’m 23 weeks prego. My husband doesn’t get home every night till about 6pm and we get ready for bed about 830ish. I barley get to see him, have conversations or anything and my son doesn’t see him much either I am at my breaking point and he thinks I’m being silly. He keeps saying I had to work from home with him I’ve been through it your fine. He worked from home for maybe 4 weeks I have been working from home since August. Plus he got to go see he work buddies cause he went in late after I got home. Trust me it wasn’t hard work it was fun he worked for an ammo company. Well I tell him I need a break and he decided to go golfing for 6 hours today!!!!!!! I’m so pissed I want to flip shit on him. Am I being crazy?