Pcos and so very frustrated! Any advice?

Erin
I am 23 and I have pcos and am overweight because of it. I was on metformin for about 4 years (because of a misdiagnosis) but because I have naturally low blood sugar I was sick the entire time and nearly died from it. Three years ago they finally figured out what my problem was. I was taken off all medication and became very healthy (still overweight but very healthy). About 6 months later i concived and I miscarried at about 4 weeks along. My so and I have been TTC ever since. My dr recently diagnosed me with pcos and put me on Adipex to help me lose weight. Its been a few weeks and my results have been up and down. I feel like giving up. I hardly eat anything other than fruit and constantly exercise. Yet my weight loss is overall minimal. Some days I lose 5lbs others I gain 5lbs. I'm doing everything' they tell me to but I'm not getting results. Has anyone else ever had this happen? Any advice is highly welcome. Its killing me to see the disappointment in my so face with every neg. test.