Husband says I’m nuts?

So I want another baby. My husband said the other day he wants another one just not with me because I’m crazy. ( he kinda was joking) but today he told me he just doesn’t want another one. I told him I’m not gonna have regrets of not having another child due to him not wanting one ( it’s been two years he still hasn’t changed his mind lol) and I’m not giving up what I want to make him happy” he said really you don’t want to be together if you can’t have a baby”. And we do nothing I want, he doesn’t compromise it’s his way or no way. I’m sick of giving up shit. So he can live the life he wants and still bitches that he’s miserable.