TTC with one ovary

Wondering if anyone else is in a similar situation...about 7 years ago, I had a cyst and had to have an ovary removed...after the surgery, my surgeon also told me that I had endometriosis. I have spent 7 years stressing myself out thinking that when the time came, getting pregnant was not going to be an easy road. My husband and I just got married on March 14th and now I am even more stressed worrying about our chances of getting pregnant. Are any of you ladies in a similar situation? One ovary and endometriosis??? I need some help with convincing myself we have hope. Thanks!!!