Help! Have you gotten pregnant with 1 ovary?

Kristy • 29, Mama to miracle baby girl after 3+ years of infertility, Dog mom, Speech-Language Pathologist, TTC baby #2
My husband and I stopped using condoms right after our wedding in April, and have been actively trying for 5 months and haven't had luck. I keep blaming myself because I only have 1 ovary due to a ruptured ovarian cyst when I was 12. 
How long did it take you to get pregnant with one ovary? I'm wondering at what point I need to consult a fertility specialist. Baby dust!