Trouble with breastfeeding, FTM please help!

In the beginning it was a little easier, but lately it gets so difficult to feed my baby now. I know you’re supposed to feed him every 2-3 hours, but sometimes it takes about 2 hours just to feed him because he keeps falling asleep. I feel like ripping my hair out, and crying because I’ve already been told he’s losing weight and his skin has a yellow shade (Along with his eyes) it’s hard to get it to his normal white shade. He’s only 6 days old and I feel like I can’t feed my baby correctly. Every time I see the doctor I just feel even worse about it. I love my baby, more than the world. But why can’t I do the basic need to feed him?