Maternity Clothes

I know every woman is different and our bodies change differently. When did you start wearing maternity clothing or if you didn't then just bigger clothes? I'm about 10 weeks and I needed shorts for summer so I just a got a pair of small maternity shorts since by mid summer I know I'll need them. I felt strange though like I was way too early to be getting them. Any thoughts??