Tired of being jerked around... 🙁

💕Samantha
My husband and I have been trying to conceive for a little over a year. In January I finally decided it was time to talk to my doctor as I'm a 27 y/o woman in good health. I did blood work that came back fine & then a transvaginal ultra sound which stated I have PCOS. The doctor told me to lose some weight and it will help. I lose 30lbs within 6 months with a healthy diet and exercise. 
I was prescribed Metformin in January, my GP prescribed it for me and told me if it wasn't working to come back and we would try something else. 
- June... Decided Metformin wasn't working for me, it was completely stopping my periods instead of regulating them. I return to the doctor and she says there's nothing else she can do for me and refers me to a gynecologist. 
-July I meet with a very thorough gynocologist. My first appointment she runs through some family history with me and tells me I need to lose more weight. She tells me to come back August 4th and she will see if she can prescribe me something.
-August I go back for my appointment and a whole different doctor sees me. She does a papsmear, runs some tests to make sure I don't have cervical cancer, does a breast exam & tells me to come back in another year if I'm still experiencing infertility.... I was pretty annoyed and asked for a referral to another doctor if she wouldn't help me. She referred me to a fertility specialist and now I have another appointment for next Monday. 
Has anyone experienced the same issues? 
Anyone taking clomid or any other fertility enhancers, were you prescribed them from your GP/gyno? Or did you have to see a specialist as well? What questions should I be asking... Etc?