Bad Timing

Does anyone else have issues when it comes to fertile days lining up with times you can BD? My last two cycles perfectly put my most fertile day on the ONE day I cannot BD, my husband refused when we were staying at a B&B; because he was weirded out by the host staying the floor below us. And last month it fell on the day my husband's brother got married and we stayed at his parent's house. Now this month Glow has so graciously put my misty fertile day on thanksgiving, so again staying with family. At this rate we're never going to get pregnant I'm so frustrated and upset I almost can't keep it together.