PCOS and pregnancy

I was diagnosed around a year ago with PCOS. My original obgyn was amazing. She was very encouraging but also very honest which I found encouraging. Due to a move out of country I had to switch Dr. The one I am seeing now basically told me my chances of having kids naturally was almost 0% and if I wanted kids I needed to start trying now. My husband and I talked about having kids but have both decided it’s not something we want at this exact moment in our lives but I cannot shake the dr statement about now or never basically. Anyone else had experience with a dr not being exactly supportive?