Waking a sleeping baby??

So, I have a question. My baby is about 5 1/2 weeks old. I feed him 3 ounces every 3 hrs. Anyhow at night sometimes I have to really try and wake him to eat, sometimes he will go 4 hrs and I’m sure could go longer. Would you let him sleep or continue waking him?