Do you work the "infertility shift?"
This is still a novel concept until more studies are done. But I have been a night shift worker for 10 years now and just started cycle 12 TTC. My PCM said that I may be having trouble because of my night shifts and sleep cycle. Google "infertility and shift work" for more info.