How do you know when it's the right time to get pregnant?

Ellie
I'm now 31 years old and fear it's too late for me to try.
I've never tried before simply because financially things have been very difficult and I've barely been able to care for myself.
Also, having been sexually abused for many years since my youth, including raped, meant by choice I've had less than four sexual partners, all of which ended up abusive and violent except my current one.
I've been with him three to four years now and we married this May the 25th.
I've wanted nothing more than to be a mother, craving for it to happen since my teenage years.
My husband has Aspergers or so I suspect, he's not the most emotionally supportive person, so I do worry if I can get pregnant and I suffer greatly (on top of my chronic pains already!!!), will I even be able to hear it and feel quite alone. Also as desperate as is to be with child I'm petrified of the idea of birth, that scares me.
Any advice would be much appreciated, thank you, sorry for sounding so vulnerable and like a wuss.