Baby’s head measuring small!!!!

So my son was born at 37 weeks. I just had his two week check up yesterday and was told everything looks great except possible concern for his head circumference being in the 1 percentile! Neither me nor his dad really have small heads. My head is kinda small but not noticeably. Anyway he was a small baby due to being early. Dr stated that there’s nothing to worry about right now since it is growing on his curve. Any moms out there that’s gone through this or going through? Any real concern?