Maybe you could help....

I am 36. My husband and I have been trying for a year.. But I have tried on my own before marriage..

Here's where it gets a bit tricky. Before trying.. I told myself I wanted to wait for marriage, again.. As my first husband was killed6 years ago this past January.. How ever ended up getting pregnant with a condom breakage 3 yrs ago.. At that time I found out I was pregnant with a "Blighted Ovum" then really wanted the child I lost.. With no luck and seeing a doctor, I was then told I have PCOS, and my chances were slim because I didn't ovulate regular. After being put on Metfironin.. I now ovulate every month regular, to the point I question do I have PCOS. Now that we are trying I went to see a fertility doctor. I've done the test to check your tubes, both clear, the test to check my uterus, where I am told I have fibroids but that they are not blocking me from getting pregnant. And am told "I don't know why you can't get pregnant". And that this just means it's God's timing. What else can I do? What am I missing? Am I honestly a lost cause?