Holiday when ttc

I've been trying for a very long time, almost 2 years. This cycle I am going to be on letrozole and I was wondering if going away straight after having the trigger shot would affect my chances of conceiving? We had time off booked but the day 10 scan came in the middle, so hoping to go away after that now. Really need a holiday but just don't want anything to ruin our chances.