Head measuring small at 24 weeks

We had a repeat anatomy scan today and were told baby's head is measuring small and need to come in for another ultrasound in 3 weeks. Her head measured small at 20 weeks as well, and has grown since, but is still measuring small. They didn't seem too worried but said if we don't see a decent amount of growth in the next 3 weeks I'll be referred to a high risk OB, so naturally, I'm now in a panic. Has anyone else had this happen and baby was just fine?