One ovary and ttc

Shelbi
I get pregnant with first baby not long after my ovary was removed do to a ovarian cyst  but now my curent partner and u are ttc. We are worried that this will make it hard for us to get pregnant!!! Any thoughts