I want advice from moms that have kids/babies already here, please! :)

I work full time and commute an hour+ each way. I get a couple of hours with my 8 month old at night and then whatever is left of the weekend with him (after running errands, cleaning, seeing friends/family, etc). My issue is this: I don’t want to leave my baby! I deal with it when I go to work because I am providing for him but I keep having friends (most without kids, one with) ask me to do things that are not kid friendly or specifically saying “just you and me!” I don’t want to be rude and I don’t want to seem like I can’t be away from him but honestly- I don’t want to! I feel that my time is already limited. I would honestly be a stay at home mom in another world but I love my job, it helps provide for us along with my husband’s job, and my bosses are nice and flexible... do I need to just directly tell my friends this? I brought him to a friend’s birthday at a pool and she seemed very irritable about his normal baby behavior and made me uncomfortable, I just had another friend ask to do something “just you and me” this summer, my mom friend who also works only likes to plan drinking hangouts... this is my first baby and I feel that I will outgrow this mutual dependence but I want 2 more kids... this is my life now!! I get 52 weekends... that’s 104 days a year of quality time... I want to occasionally step away for a date night with my husband... and I just don’t want to give up anymore time than that...what do y’all think? Does anyone else on here feel this way?