Boy moms I need diaper advice

Okay so I probably sound silly but I’m struggling to prevent my son from peeing out the back of his diaper and on his clothes/bedding and then that wakes him up. I’ve read this is normal but I can’t figure out what works for us. I’ve tried moving him up a diaper size, I make sure the diapers are put on right, I have pointed his penis down in the diaper, I’ve folded over the top of the diaper, I’ve tried different brands, and at night I’ve had to double diaper so it holds his diaper in place (I change him during feeds). I don’t want to double diaper him during the day so this still this occurs and he’s 4 weeks old this week 😓. Moms I need help what should I do?