is it too soon??

so my bf and i just started dating will be 3 months on sep. 4.(little background he's been in the navy for 3 years now and I'm his new girlfriend in a while.i should also mention that I have a 2 yr old son.)anyways since we began dating we've been really open about everything and he's told me a few times that he's always wanted a son since he turned 18 he's 21 now.He tells me that he's tried of waiting and that he wants a baby with me.I told him it was too early right now and he says he respects that.but he's been so insistent on it that i finally told him we could begin trying on my birthday in nov.27.we will be a few more months into the relationship and we won't get so much ridicule from his or my family. Would you say that it's too early for us to have a child together?