Am I wrong?

I entered a marriage with my husband with the agreement that we will have kids sometime in the future. He is now in a place of not wanting kids at all which is perfectly fine, but I still want them. Will I be wrong to make the choice at some point to end things with him? It will be one thing if he had this opinion from the beginning and I thought I could change him, but for him to change his mind this far in when I still want them is a different case. I will never try to force him to have them cause I don’t want to raise kids with someone who isn’t there by choice. But I also don’t want to give up something I want because he no longer wants them.