Am I being irrational ?

I had my daughter in the hospital and I just wanted a bit of family time. Just me baby daddy and baby. Baby daddy invited a whole bunch of people. Ok whatever I was ok with it. I just wanted some time to soak it up without all the passing baby around and noise. Well like an hour or so later he invited his friend they come up and then go downstairs to smoke pot. He comes back up high as hell. Wearing a whole bunch of axe cologne and smelling like straight weed. I was pissed because like really? Why would I want my baby around that. Idk maybe my hormones are making me rage. He just seems to not care about how I feel at all with everything. Don’t regret baby at this point just her dad.