I need opinions

Pais
My husband and I got married 2 years ago and he adopted my daughter. He now wants another baby. However when we married we had planned on not having any more children. In your honest opinion do you think it will ruin our marriage if I do not have another baby with him?????