Men are confusing af!!!

So me and my husband started trying for baby #2 after my last period was over. He said he was ready and then a week after he said he didntwant to try anymore cause he wants a bigger place for us. The same night we had unprotected sex. And did it again a couple nights ago. And is talking about “when we have another baby” so I feel like if we are pregnant and I tell him he’s going to be very unhappy and not supportive. It also adds that stress on of I won’t want to test if my period is late.