Not sure what to do

I've been with my boyfriend for almost 2 years. We each have a kid from a previous relationship. Near the start of our relationship, we had a pregnancy scare, which promted us to have the "what kind of future do you want" talk and I made it clear that some day I did want to have another child. He said that he did as well. So anyway, now that we have been dating long enough that I feel comfortable actually planning to try for a baby, he tells me he doesn't want one, ever because he "doesn't want two baby mamas" and doesn't want to start all over with diapers and stuff. I know that having a baby isn't just my decision to make, so I'm not going to try to change his mind but I don't know wether I should stay with him anyway because I live him and we Co parent our kids well, or if I should end the relationship because I feel like I'm being forced to give up on something so important to me.