How much is too much?

I am 145 lbs over weight... That is an entire other persons worth of weight. We have been trying to conceive 3 years in November. It is suspected that I have PCOS and endometriosis but not confirmed. My doctor wants me to try metformin again for a while and concentrate on losing the weight before we focus on getting to conceive. But it's overwhelming. Where do you even begin? How much weight is TOO much to lose?