When to buy clothes

I am so excited to be pregnant and I am wanting to buy stuff but my husband keeps telling me to not buy anything till we know the gender I am only 4 weeks should I wait or is it okay to buy small things here and there?