6 week old doesn't respond to my voice

Is this normal? He makes eye contact when I have in front of me but not when I'm feeding him or holding him. Definitely worried!