Why are men afraid to get outside help for baby?

My husband and I have been married for almost 3 years now and have been trying to conceive since the wedding. Although there are some important improvements in my health, mentally I am getting really frustrated dealing with the disappointment every month. So I decided we should go see a specialist. I'm 31, I'm active, I have endometriosis but it has been improving a lot thanks to some personal practice. My husband is the same age and also quite active. There's really no reason there should be any serious issues but he blows up about visiting a doctor which will just lead us to ivf (we both decided we would rather avoid this route if possible) and how I just want the doc to say it's a problem on his side..and he got so upset over it. I don't understand why it's so difficult for him to accept getting a check up just to see if everything is good on both sides? I feel so angry towards him and frustrated that he would react like this. It's as if he doesn't want to try everything to have this baby. It's also hard for me to let things go...I feel like my pride may prevent me from wanting to try again this upcoming month...I'm so angry.