Calling all young moms!!

So.. I'm 19 going on 20 and my boyfriend is 21 going on 22. We have our lives together and we are very financially stable. We have been together for a little over 3 years now and we want to start having children. Part of me does but the other half of me thinks I'm too young. What do you guys think?