Baby Projects on Pause

We got married a few months ago and started our TTC journey right after the wedding. I was very nervous, started reading a lot about conceiving and made diet + lifestyle changes right away. I did all this because I have been experiencing extreme pain right before and  during my period and my OB-GYN said it could be endometriosis which by the way, only gets worse if left untreated. Yet she told me to try for 6months and then come back if it didn't work out.
So I was on it, determined to get pregnant against the odds and quickly.
A few months into it, my husband told me he was having major anxiety about our relationship and wanted to put our baby plans on hold for a few months, the time for him to learn to deal with his anxiety. 
I agreed. If this is what he needs, I will be supportive.
This left me in great destress though. Having to delay our project, not being sure where our marriage stands so early on. 
We've talked about it. But this doesn't make any difference to the extreme saddness I'm feeling.
I don't know what to do, and how to deal with this situation. I was definitly not prepared for this.