HELP- is it to soon

How do I convince my husband we need to start trying again? 
He's worried about another miscarraige. We've had 2 in 12 months. 
I'm ready... its been 4 weeks since the last and trying is the only thing I can think about. 
Having a baby is all I think about.
I've recently lost my job and we are selling our home but due to medical conditions we need to be trying sooner rather than later! 
Am I stupid for wanting kids now? When everything seems to be against us? Help please.