Pregnant and last baby.

Okay so husband and I had agreed on 3 kids max of 4 but on my head I knew I would be done at 3, currently 20 wks with out 2nd and we had a conversation just last night husband wants it to be our last baby!! We have a boy and now having our girl. I’m happy because I’ll have my boy & girl, but still my heart is broken. I’m a SAHM, we are somewhat financially stable but he states he wants to focus more on paying off our house we recently got and just start to save money for our kids future, he works a lot since he’s the only provider but he’s always been present for our little family and always play with our kid, I asked if I got back to work would it make it better but he rather me focus on our kids. Anyways he also wants to continue to be present on our kids lifes and doesn’t see it happening if we increase more our family size because he works extra hours and he most likely would have to get a second job if we were to have another kid. Idk I’m mentally not prepared for this baby to be our last and he honestly broke my heart with what he said🥺idk I just wanted to rant and ask if anyones been through this? How to deal with it? Did it affect marriage? How can I mentally prepared for it to be my last pregnancy if I am not ready? I always dreamed of having 3 kids.💔 honestly I love my husband so much and I wouldn’t divorce over this but y’all I’ve cried all night!