Breast feeding

I have a 3 week old baby. He’s breastfed but for the past few nights he’s been so hungry, as if my boobs aren’t giving him enough milk. He’s fine throughout the day but once night hits he’s screaming in hunger, he’s sucking his hands will suck so hard on dummies ect. Can I do one formula feed at night & breastfeed every other feed? I don’t know what else to do, he’s so hungry