Nervous about money after baby comes?

Is anyone else nervous about income after the baby is born? Right now me and my husband are living comfortable, however I won't be able to go back to work full time due to lack of a babysitter and daycare is too expensive here and my husband is against it.  He says he knows we will be fine but it stresses me out. Going from 40 hours to 20 is scary! Any thoughts or advice?