Too stressed out?

My husband and I have been trying for a year now. We have both been checked and everything seems fine (sperm count, regular periods, ovulation, tubes open...) - we eat healthy, we excerise regularly and yet, still no baby. 
We have also been under a lot of pressure lately. We're selling our house, building a new one, therefore the frequency of our arguments has gone up tremendously.
Has anyone ever experienced not being able to get pregnant because of stress and arguing or is it just a myth?
Thank you.