Am I wrong to feel this way ?

I'm a SAHM my husband works as a welder who goes out of town occasionally this week he had to go to Vegas hes been gone since Monday. Its currently 3:51am and hes still out gambling drunk. I told him to go back to his room and sleep since he has work later all he keeps saying is hes not doing anything wrong . I'm honestly upset since hes been there hes been drunk every night having fun while I'm home dealing with a fussy baby. I never get time to do things like that if I do have a night out im just thinking of our baby. I just want some time to relax alone! I'm jealous that he gets to be out having fun without the worry of anything. Every time he goes out of town for work he ends up out drunk staying up late but when hes home hes soo tired by 9pm. Am I wrong to feel like this ? Am I just being a bitch ? Honestly I feel childish to feel this way but I cant help it !

UPDATE: I went to bed woke up with the baby at 8am saw the last time he read my message and was on Facebook was at 630am I called him it was ringing he didn't answer I tried two more times and this last time he turned his phone off !