Sleeping through the night?

Dr gave the go ahead to not wake baby for feedings (He’s 3 weeks and 3 lbs up from birth weight). Tonight’s he’s fussed a couple times but by the time I’m up to get him he’s fine. It’s been 5.5 hours since the last feeding. Should I be concerned?