Should we see a fertility specialist?

Me and my husband have been trying for 2 years about a year ago I talked to my Gyno about it. He helped my mother in law get pregnant with her 2nd. He diagnosed me with PCOS after an ultrasound and gave me Provera to start my cycle then we did 3 rounds of clomid a round of 50mg, then 100mg, and the last was 150mg. I did not ovulate with any dosage so I asked about metformin. He put me on metformin and I got one period from that he put me on clomid and still did not ovulate. Now it’s 6 months later. We’ve only met with him in person twice but obviously the clomid isn’t working. I called and asked the nurse if I could get some Provera since I am 27 days late and she said this is the last time she can give it to me and no clomid this month since I have to go in for my yearly. I’m wondering if I should go back to him or see a fertility specialist? Any insight would be appreciated.