Endocrinologist for PCOS?

I was officially diagnosed with PCOS in April of 2019, by my OB/GYN. I went to him after trying to conceive for a year, and missing a period for the last four months of that year, with no pregnancy. He prescribed me birth control pills and sent me to a dietitian to help control/lose weight (gained 100 pounds in a years time). After 3 months, and no weight lose, obgyn prescribed Metformin, which I’ve been taking for 5 months now. I have lost 10 pounds while taking it, but have fallen off my schedule of taking Metformin twice a day because of all the traveling I’ve been doing during the holiday season. Anywho, I just found out that an endocrinologist is a doctor who specializes in hormonal balancing and hormone-related syndromes. I am wondering if switching care to an endocrinologist would be worth it, if they could help to better control my symptoms and regulate hormones without having to take the Metformin (and possibly not the birth control pills). My husband and I are not currently planning to try for a baby any time soon, but I don’t want to leave my symptoms unchecked and become infertile because of pcos. Any advice on whether or not an endocrinologist is better suited to treat pcos than a gynecologist?