My husband want to go to Vegas

So ladies, we have a lot of responsibility from day one (or when we find out we're pregnant). Dads to be can only do so much.

My husband's work chose us to go to Vegas two years in a row....so fun! We were invited for 2018 and I don't want to go almost 6 months pregnant. Should I care if he goes without me?

Initially, I was a little sad he would even think about going. We've tried 5.5 years and even did IUI (unsuccessful). I've been so sick and he hasn't been to either of my ultrasounds. Maybe I'm a little annoyed? But then, I think part of it is because I have had so much fun in Vegas and was jealous I couldn't/don't want to go while pregnant. I don't want to be controlling and think I'm thinking more about myself.

Would you want your husband to go or skip a year? How would you handle it?