Affording the baby-house-baby-house-school/baby?

Alisha • Husband and I have been married for 5years, together for 7 We have 3 fur-babies and are looking to expand.
We decided to TTC 3 months ago. Now hubby wants a house instead - it seems like he is all over the place between baby house and school when a few months ago our only plan was to pay of debt. I know we will never be ready really. But I feel
Guilty of we do try, but it feels like now is the time - and hey it could take years but.... I dunno? Anyone else ever feel this way?