Ovulation is ruining my girls weekend 😫

Hello all asking for advice on traveling and ovulation. My husband and I are just now starting to get serious about trying after covid pushed back our wedding 6months. Every month matters considering we thought we’d be very pregnant by now and we’re really excited to start a family.

We’re both around 32 as well so not getting any younger as a factor as well.

Anyways, my girlfriends scheduled a girls trip smack in the middle of my ovulation cycle. My husband is mad at me for wanting to go considering I should be baby making and that should be my priority. They are all single and really want me to come and don’t understand the urgency when “I have my whole life with him to have a baby”.

It seems silly to cancel a memorable trip but also silly to postpone my future family...any advice/tips? Are there ways I can bring his sperm with me? Am I being selfish if I go? Should I go?