Not gaining weight

My son is 4 weeks today and he still is 3oz under his birth weight. I feel like I am going to cry. I feel like such a failure. All the nights I let him sleep because he didn’t wake me up to tell me he is hungry. I was starving my kid. 😔