Should we go for #3?!

I have been very blessed and thank my lucky stars daily for my two beautiful boys. (ages 1 and 3). I have always dreamed/imagined my life with three kids, however my husband is happy and done with two. He thinks our house is crazy/loud enough and having another would just put us over the top. Our one year old is still not consistently sleeping through the night so I don't think that's helping his thoughts. He has told me though that if having another baby is something I really want to do he won't not do it. He would do it for me, but says he disagrees with the decision to. I'm torn. I don't want to force him into having a baby he doesn't want...but I also know I will regret not having a third in the future if I don't. What would you do?!