How has endometriosis effected your fertility?

I’m 23, have an almost 2 year old, and was just diagnosed with endometriosis. Me and my husband were thinking of trying for baby #2 next summer, when my son would be almost 3 (his bday is mid Oct.). I’m kind of concerned with that time frame though because my doc said to have my babies young and sooner rather than later because of this diagnosis. I’m not ready for another yet and I was also diagnosed with adrenal fatigue and estrogen dominance so my doc told me not to go on birth control until we get my hormones figured out, while my gynecologist told me if I want to wait that long I need to get on birth control so the endometriosis doesn’t get worse. Has anyone been through this and have advice on what I should do based on your own experience? TIA.