Am I wrong?

So my boyfriend and I started talking about our future, we plan on moving in together when my lease is up next March and we talked about having a baby (we lost our first early in our relationship). He wants to wait another year before we start actually trying br said if it happens before then he is ok with that. He has no children but I have two. How do I tell him I really don't want to wait? I don't want to break his heart but I don't want to have a child in my late 30s. My kids will be teenagers by that point and I don't want to start all over again. When we started dating I told him I didn't want anymore kids and he was fine with that but our surprise baby changed both of our minds, the only problem is I don't want to wait I want to try now. Just not sure what to do or if I'm wrong for feeling this way.