My two week old gives hunger cues but then doesn’t eat

My baby has been fussy lately. He’ll send out intense hunger cues like opening his mouth, eating his hands, looking side to side but then when I give him food (bottle and breast) he doesn’t want it. He’s fussy while it’s in his mouth. What can be wrong?