Husband is getting cold feet

My husband and I decided to try for our first baby. He's the one who approached me on topic and I agreed. We started BD a few days before my ovulation. Day before my ovulation and he freaks out, won't even touch me. I asked him about it and he said he's scared that we won't be able to afford a baby. Anyone else go through this and how did you calm his nerves?