When does baby respond to noise?

I may be being a worry wart but I haven't noticed my baby showing any response to outside noises yet. I'm 24 weeks and 2 days and maybe it's too soon for that... I feel little kicks and movements at random all the time now but it never seems to be in response to a noise. Should I be concerned?!