traveling without baby

Je
So my baby is almost 4 months old and I am full-time stay-at-home mom. I feel like I really need to get away for a night or two and my mom who is awesome said she would watch him for a weekend while we go to the beach or something. My significant other thinks this is irresponsible and we shouldn't be leaving him so soon but easy for him to say that since he goes to work every day and gets out with his buddies sometimes on the weekend. I love my little dude so much and when I am with him I give him 100% but just think a little break to recharge my batteries would do wonders. What are your thoughts moms about leaving little one for a night or two? I just feel like my significant other is overreacting and it's not being irresponsible it's taking care of ourselves too!