Infertility and anger.

My husband and I are faced with the prospect of <a href="https://glowing.com/glow-fertility-program">IVF</a> in January after 3 years of TTC. 
Lately he has been very angry, losing his temper easily and telling me to F Off. 
my friends are saying he doesn't make me happy, but he does most of the time. They are also questioning bringing a baby into things as they are now. 
It is myself with the infertility- he is fine - and I just wondered if anyone else had any experience with their partner's anger issues during the journey. 
Any help would be appreciated! X