32 and TTC...kinda?

So, I'm going to be 33 next month. My husband is almost 3 years younger than me. He's been on the baby wagon since the beginning. He does want kids. However, he says he wants a child now he isn't trying hard enough for a baby. And now I'm afraid the older I get the harder it will be to get pregnant and to stay pregnant. I know all women are different and I could have a healthy baby at 40... but the point is I don't want to waaaait much longer. We haven't really even tried for a baby. I'm not on birth control, never have been, and we don't use protection. So, any time we have sex is a chance. But I'm also not a spring chicken. My periods are regular and healthy... So... Are we not trying hard enough or is time really not on my side?

Help. Advice?