Still living with parents...

My husband and I are living with my dad, step-mom and stepbrother and really want to start our family. We got pregnant when we first started dating but ended up a miscarriage. We moved to my dads house 4 months ago and we are ready fo start a family. My concern is would it be to stressful for all of us under one house to add a baby? My husband works 40+ hours a week making good money and I'm a full time student. Full support from family but just want opinions. Thanks :)