TTC again?

Hubby and I have 3 kids, all 3 and under. When we got married we said 3-4 kids. pregnancy was very hard on me and our second has health issues, he has been doing amazing. We are turning 37 and 40 in the next few months. He has been talking about adding 1 more sometime next year, after baby turns 1. I’m not sure I can physically do another pregnancy, plus we moved several states away from my OB and midwives and I’m not sure how a new team will handle my Hyperemesis. Being so sick again is my big hold up, plus the fear of another child with health issues because our second looks like a train wreck on paper but is doing so well and I don’t know that we would be that lucky again. We 100% could afford another and have room. It would also further delay me going back to work, plan was this summer, I was laid off in summer 2020 due to Covid.

I guess what I’m looking for is in this situation would you go for 1 more?