Too young?

My boyfriend and I have been together for 5 years. I'm 22 and he's 25. We would really like to start a family but im so worried about what my family and others will think about me. I feel ready and we are both in good jobs and are living together. I think I'm just being silly but I'm so worried about what people will think.