The blame game

Shelby • 26. Married. Wyatt James 2.26.18 💙⚓️
Today I'm feeling a little down because I had a negative test and I just feel like AF is about to come. I so desperately want to be pregnant and I suppose my hopeful wishful thinking sets me up for disappointments. Anyways, I told my husband that I was feeling a little down. And being the sweet and supportive guy he is said "I mean, it could definitely be me. I work with chemicals all day and have for years." I know this was an attempt to console me and there is some truth to what he said, but it ended up upsetting me because I think it's too early for us to be deducing that one of us has a fertility issue, and I certainly don't want to play the blame game. 
Advice welcome.