Cancel a trip without my husband since it’s during ovulation?

I have a trip coming up to visit my family and my husband isn’t able to go. It happens to be during ovulation and we have been trying to conceive for 2 years with 4 miscarriages. Should I cancel my trip to try and make a baby or skip the month of trying?