TTC w/ Fibroids

Hi.. I am 25 y/o and I have been TTC for 3yrs w/ my fiancee. I was diagnosed with uterine fibroids last year. Since then i have been to the obgyn several and have gotten ultrasounds. The doctor informed me that my uterus lining, ovaries, and endometrial is fine. But i still have not gotten pregnant. I just recently have been tracking temp and ovulation symps more accurately w/in the last 2months. I am really started to get fustrated. Has anyone had babies w/ fibroids???