Two stay at home parents

So my husband was injured at work (military). This led to other issues, CRPS and Fibro. He is being medically released in April of next year. I'm due the end of November this year with our first. I was working on base as a civilian and my contract is now over. I'm on maternity till September of next year but I don't have a job to go back to. When my husband is released he will be on long term disability because he can not currently work. We had always planned on me being a stay at home mom, and we still want it. But, this would mean that we are both home and living off of his disability cheques. We did the math and can afford it, things would be a little tight but not too bad. I just feel like this makes us lazy people. Both not working and living off LTD... Seems bad right? Thing is, idk if he would be able to handle the baby all day long while I'm at work either, his hands get really bad sometimes. Maybe I'm worrying too much about what others think, but I don't want to come off as "welfare bums". Im a well educated woman and my husband was a hard working man until his injuries. Am I over reacting? Is this really ok to do? I want to be home with our son so bad.