When is the right time to have a baby?

I need y'all's advice. Having baby fever lol as many people say :( I'm 22 and so is my husband. We got married at 18. Many people thought I was pregnant lol but wasn't when I got married. My marriage has been very rocky in the past 3 1/2 years. An it is bearly going very well!! Because me and my husband didn't really see eye to eye on things I didn't want to conceive plus I thought I was too young and I still want to go back to school again and so on. His job is seasonal and just things would indicate it's not the right time for a baby. Now I work at a hospital and have a steady better income wit health insurance ! And my husbands job looks like it's picking up on both ends (is self employed. By one company and owns the other) we are trying to clear out dept and all. But I cannot lie I feel like having a little one. Even though I know it's hard work and requires full attention. I can't help but to look at our second empty room and think about it. It's a scary feeling for me because I never imagined myself having kids. Our parents would die if they had a grandchild from us. From my husbands side because we are the only stable marriage at the moment and my side because I'm the youngest and oy girl. When did y'all feel like it was the right time? I need a little of advice :/