Ttc with a 'simple cyst on left ovary'

Anyone know of/ had any complications trying for a baby with a small cyst on their ovary? I've read up and can't see that it interferes with fertility... Doctor also confirmed this. But has anyone actually got pregnant with a cyst there? I worry so much! But irregular periods and Ttc for a year and still nothing... I'm fed up!! 
* Please comment! I always post up here and nobody seems to bother commenting 😳