Doable?

My fiancé is E-4. Were getting married next month and we’re having a baby. If we live on base, is it feasible for us to live off just his income? He wants me to stay at home with the baby but I worry that I need to work too to support all of us and to contribute. I am NO means above working or helping out my family or being dependent on him. But when the baby is first born I feel like I am going to have to stay home for a bit