Want another child, husband doesn't.

I know, before you say "you should of talked about it before you got married", we did. We both wanted one, but I still wasn't too sure since I've never been around kids. Now I love it. We have a 1 year old boy and I want another soooo bad and he does not. It means a lot to me to have more children and husband will not budge. Is it worth leaving over something like this? I know it's not fair to my son I have now to leave. But it's also causing fights over and over that my son does see and hear. What are your thoughts?