Does having a baby really cost that much?

I don't really know anyone close who has a child. I'm 35 and have wanted a child ever since I fell in love with my partner. We've been together 4 years and living together for 18 months.

We're both 34. I'm more than ready for a child, he wants one too but feels we do not have enough money. We earn about 40k a year between us. We have our own house (with a mortgage) and our bills always get paid on time. We're very thrifty with food and electricity so we keep those costs down.

I would be fully intending to buy most things for a child second hand anyway, I don't like to buy new things if I can reuse something and save some money. Obviously some things I would buy new.

He thinks we should wait 5 years or so to have a child because then we'll have a lot more in savings. I'm trying to explain to him that I don't think children cost too much, but I don't have anyone to ask.