Confused, sad and worried

Back story * My hubs and I have been trying to have a baby for 4 years now. I have pcos and it's hard to conceive.

I'm 33 and hes 30. I have 11 year old from pass relationship. That my hubs helped raised since my son was 5. So we been together for some time now.

So we been trying for 4 years now. My doctor wants him to go get checked before they put me on extreme hormones.

So here's the issue.

Last month they told him, that they want him to be checked bla bla. He was ok with it. Once we got in car. He was annoyed with having to go and get checked. Well he keeps putting it off and of course it makes me annoyed. He went and got a gym membership and has been working out all crazy. he went to his regular doctor and got a work up as well.

Today we were cleaning the garage. We both were getting annoyed with our self's and such. We have so much junk. Well on a little break I asked him when he was going to get checked.

He got all upset. Then he said " I'm not liking our relationship right now." I was confused and I even admitted that I've been a little annoyed with him because he hasn't gone and got himself looked at. I explained that I've been putting my body through all these meds past 3years and he can't go and jack off in a cup. I was piss about this comment.

Especially since we've been having lots sex. So I looked at him in his eyes and ask him "do you want have a baby?"

Well he said "no, i don't want one right now. Maybe sometime later in life. Your son, you and myself. I just can't do it right now."

I was mad but sad. I just started crying and went in to the room. He came and said "he needs to get to gym." and kiss me bye

I DON'T KNOW WHAT TO DO OR HOW TO TAKE THIS. I want to talk to him more but I'm more Afraid to hear that he wants to move on or something. I just don't know.