Am I stuck!?

My husband recently decided he doesn't want more children. We have one. We talked about wanting kids before this so I never knew he only wanted ONE. I want at least two. I will not divorce him over this obviously. But he changed his mind and to me, it's not fair :( we do use the pull out method so the chance of pregnancy is there but I don't want to depend on that. (Yes I know pull out isn't effective lol) am I wrong for being upset? I need advice on what to do.