too early??

I'm almost 17 weeks preg with a baby girl. Would it be totally dumb to start buying baby clothes? Every time I go to look the thought of buying them makes me super nervous for some reason but I'm dyingggg to. Anyone else shop this early??