Told not to TTC because of weight?

Hey ladies! I'm 5'10" and 275lbs--the most I've ever weighed. But my husband and I just decided that we wanna TTC and I could not be more excited. Except I have this one moment giving me nightmares. A few months ago, a lady at church who is like a mom to me saw me in the restroom and said "Are you pregnant?" And I laughed it off. But then she adds "Oh good! Cuz you wanna lose some weight before you get pregnant." I know she meant it in a loving, motherly advice kind of way. But I haven't stopped thinking about it. And now that we want to actually try to have a baby I'm scared that like the OBGYN is gonna scare me with all kinds of complications and risks that I'm gonna have because I'm overweight. It's making what should be a happy and exciting time more stressful than I want it to be.