Timing for baby #2

My hubby and I have been happily trying for baby #2 for about 7 months and we are both so excited. I cannot wait to have another baby! I'm at the point where I get sad seeing other moms with two kids. But, I'm worried the timing couldn't be worse.
The last year has been really difficult for me. We moved 2 hrs away from all our family and friends to new jobs. I started to feel isolated being in a new town with no one that I know. I started having panic attacks and am a little depressed. Now our financial situation is about to get tight bc my student loan payments go up extremely high in November -- so I'm looking for a higher paying new job. I'm so stressed about it that I started having more health issues. The guilt and stress of it all has me worried that I'm not emotionally equipped to deal with having a newborn and a 3 year old at the same time. 
We are both ready in so many ways for another baby, but now that we are forced to get financial help from both our families, I'm not sure having another baby is the responsible thing to do.
I have so many mixed feelings, and after writing this I think I know what needs to happen, but I just need some feedback.
Thank you, everyone!