Rant, Feeling Selfish For Wanting #2

Let me preface this by stating that I am NOT acting on my desires. I am much more mature than my feelings, and I understand all too well that logic in this situation comes before anything else. I just need to get this off my chest.

I so very desperately want to start trying for baby #2, but it is definitely not the right time. I'm 24, my husband is 23, and our daughter is 2. Thanks to just life in general I guess, we live with my husband's parents and his brother in their 3 bedroom house. We room share with our daughter. My husband is looking for a better job because his current boss keeps cutting his hours. We are trying very hard to build our credit and save up to move out, but we have no idea when that will be, if ever. On the medical side, I have PCOS and low progesterone, which causes me to have recurrent miscarriages, one of which was a very traumatic missed miscarriage. I had to be on progesterone suppositories to carry my daughter to term successfully. I also suffered from extreme hyperemesis gravidarum, which caused extreme malnutrition in me and my daughter, and her birth ended in an emergency c-section. My entire pregnancy and birth with her were extremely traumatic and we were lucky we both made it out alive. My doctor informed me that because of everything that happened during my pregnancy with my daughter, that I would have to be in contact with him and set up a plan before we start trying again in case my HG comes back. I'd also probably have to have medically induced cycles because I don't ovulate regularly on my own. All of this screams that having another baby is 100% a horrible idea right now. But my heart and my brain are screaming at me that this might be the only shot at having the family I envisioned. It feels like there's another little soul out there calling to me, like there were with my losses and my rainbow. My husband is on the same page as me on both fronts, so it's been hard on us both. I want to call my doctor so bad, but I can't and won't because that's not fair to us or the people we live with. It's just so fucking frustrating and heartbreaking feeling like we're 1 and done against our will.