Sleeping issues

So I honestly wouldn't mind waking up a few times a night feeding LO and then try going back to sleep. Problem is, my LO wakes,feeds and then can't go back to sleep. He's happy and smiling for a few minutes until he realizes no one is going to entertain him, then starts crying. He just seems fully awake and not even that hungry. This happens from around 1 am to morning.

During the day he sleeps a total of 3-4 hours, so I don't think that's too much to interfere with night sleep.

Anyone else have that issue or any idea what to do??