Am I being "crazy"?

My husband texted me while I'm at work today and asked for my opinion about him going on a golf trip may 6-8. My due date is April 27. I said 1) I could still be pregnant then or having the baby on one of those dates and 2) it would make me sad that he'd rather go away for a weekend and golf then spend time with his new and first baby. He said I'm being crazy and compared me to some women we know who always throw a fit when their husbands do anything. He also threw in "the baby will just be sleeping and breastfeeding why do I need to be there for that". I don't think I'm being out of line by feeling this way. Am I?