Need Advice, Feeling hopeless...is this finally our time??

Hubs and I have been TTC for 2.5 years, I had a MC a year and a half ago, and I am becoming fearful that we will never conceive. I am 36, started Letrozole in Sept...at my last appt. my doc told me that every cycle was "critical" at this point. My husband and I got into a huge argument last month, after I had too much to drink when we were out with friends. I was mortified, and he is still upset almost a month later...has been sleeping in the guest room, barely speaking to me and showing no love or affection whatsoever. I feel so hopeless and depressed, and I don't know how to make things right. The holidays were particularly difficult, as all I could think was that it should have been my baby's first Christmas, and we spent it just the two of us. No baby, no family, just together knowing he was mad at me. it felt empty and awful. I have felt depressed during this time of year before, but this is much worse. How do I turn things around? I do not want to beg him to be intimate with me (which I have done multiple times in the past year because I knew I was ovulating). Do I wait for things to blow over? We have beeb married for 6.5 years and I have never felt this disconnected before...