Deciding if we want a baby or not

My husband and I've been married for a year now, and we often talk about babies and having our own. We both want one so much, but he convinces me that it's best to wait until we get our house and travel a little bit. We make 70,000 dollars in total annually, and I have friends who make so much less and have babies. He just thinks we'll be under a big responsiblity (which I agree with) and scared that we won't be able to provide for our baby. I'm 25 and I feel like I'll regret not having a baby sooner when I'm old :( I want one but I also want to travel with my husband and enjoy just two of us. I'm so confused and he is too.
What made you decide that it's time to have a baby??