When to start for a new baby

Ok so I have a one year old, and my hubby wants to try for another one I'm still debating if we should try I feel like it's going to be hard. When is a good time to start for a new baby