Advise please!!

My husband and I thought we were ready to have another babe. Our son just turned 2. I got my IUD out end of September. The more I think about it the more I can’t see having another child. I can’t imagine taking time away from him and spend it on another. I always thought I’d have a large family I have 3 older siblings. I feel like in this day and age people think your selfish for only having one child. I don’t know what to do. Plus on top of it our marriage has been much more difficult with having a babe in the mix. I don’t know if I’m feeling this way for how horrible my pregnancy and birth was. What is anyone thoughts on having one babe pros cons?