Won't give clomid

Tzip • Expecting baby number 1 February 2017!!!! baby dust to all!!!!!
I went on 2 rounds of clomid and the 3rd my gyn said I need an infertility specialist so I went to him and he won't give me clomid and trigger shots unless I lose 30-40 pounds! I've already lose 6 pounds but it's just so frustrating cuz I don't think I'm ovulating but on clomid I did. Anyone else have this?