IF & PCOS

Hi I've been trying to conceive for 3 and a half years. I have PCOS and weight issues - apparently and my partners sperm is boarder line ok. I was on Clomid and it 'worked' for 5 cycles but not the 6th. Now I've not come on since June 21st and I've lost almost a stone so that proves to the horrible consultant that it can't be all weight related. I don't know what to do now, feel lost ?Carls xx