Falling asleep in carrier help!

My 4 month old has great head control, he can hold it and his chest up during tummy time and didn’t like facing me in the carrier anymore. I started facing him forwards and he loves it! He also however loves falling asleep in it too and his head hangs forward a bit and as a first time mama I’m extra worried about positional asphyxiation. Does anyone else experience baby’s head tipping forward? Will he be okay or should I continue taking him out of the carrier when he dozes off? Please no mom shaming; I am doing my best (believe me I’ve received enough for a lifetime) helpful comments only! Thank you so so so much in advance!