He doesn’t want one

So we talked about wanting a baby before and agreed to ttc. After arguing a bit for like a week (not arguing about having a baby) he said we should wait a couple weeks to try again (makes no sense I know but he’s a man)

Anyway, since then he has been pulling out even though we thought I might’ve been pregnant this month before my period started and he said he was excited if I was pregnant. And I even said I had baby fever after my period started and he just said “oh god baby” and then changed the subject essentially.

He pulled out again today so I don’t think he wants a baby with me anymore. I give up the idea of it :/

Edit: we both have 4 year olds from previous relationships