Struggling with PCOS

So my husband and I have been trying to conceive for just over a year now. A few months into trying I was diagnosed with PCOS. I was out on clomid and never, in all those cycles, ovulated. Just tried my first round with letrozol and didn’t ovulate. My doctor is trying another round of the letrozol with a higher dose. I’m not hopeful. Nothing I do works.

At this point I feel like I’m just wasting my time and should go straight to a fertility specialist. Has anyone had a similar experience? Any recommendations on fertility specialists in Connecticut?