When to start trying get pregnant?


I want to get pregnant in November and my obgyn said not to take the IUD out until I am absolutely ready but my friends and husband say to take it out in September. Idk what to do is that too early? I haven't had problems in the past with conceiving but what if I do this time? Problem is I have a lot going on in October and a wedding I'm a bridesmaid for early November so I don't want to get preggo too soon. Help!