Anyone feels judgment for wanting a baby in your 20s?

I'm 24 and my husband 27. We are thinking about ttc soon but I'm afraid of being judged that I am too young or it's too soon. Anyone out there relate?