is my body trying to tell me something?

Jay
5months TTC but seems like it's not meant to be. Every month I get a cold in my fertile window. So we end up just having sexonce or twice. Is this a sign it's not a good time? Planning for baby #2. Is my body trying to tel me something? Or should I just stick it out and keep trying?