Trying to lose weight while TTC

I was on clomid for 2 months and gained 20 pounds and still no baby, so upset right now :(. I feel disgusting, my sex drive is at an ultimate low and I just don't know what to do. I've been trying to motivate myself to diet and exercise, I cut out all soda and caffeine and limited sweets. It's been about a week but no weight changes, so frustrating. I am considering taking garcinia Cambogia tablets I bought at GNC. I have been ttc for almost 3 years and I am worried there may be side effects that will effect fertility. However, I am almost 50 pounds overweight (I'm only 5 ft and over 160) and I feel like my weight may be a contributing factor as to why I haven't conceived.

Did anyone have luck with this while TTC?