plus size TTC

Lizzie • Pregnant with baby #3 😙 Team Green 💚
So my husband and I are thinking of starting to TTC, I've recently lost 40lbs and I am going to try and lose more. My primary dr has said I can start now, that my weight is okay (bmi is 34) but I have heard some women deal with a lot of negativity and obstacles when plus size (over 30bmi) and pregnant. What are your thoughts??? 
Keep losing more and wait to TTC in a few months or start noe while still eating healthy & working out? 
Thank you!!!