New job and want to start trying?

My husband finally agreed to start trying for a family last Christmas but we wanted to go on a trip to where he grew up first as it's a long flight and we didn't want me doing it pregnant so we settled on holding off trying until April. I was offered a really good job in March which I accepted. So we decided to put off trying again so I'm wondering how long is good to wait - I don't want to conpletely screw my new boss.