Wants vs. Needs

Jackie • 24 just married
So my husband and I have been talking about starting to try to get pregnant. In December, we r currently looking to buy a house but for now we moved out of our cozy condo and moved back in with my mom, and 3 brothers... So not much romance has been happening. Am I selfish to want to start trying for a baby with out a plan as to where we will live.(either get into another rent or wait and buy) Or should I just go with the flow!?!? I need some guidance, my heart wants a baby, but my mind is worried that we r not ready. But who is ever really ready???