Laying on his side

My baby is 3 weeks old & when he lays in bed with me he always goes to lay on his side. I feel like that’s so soon for a basically newborn… anyone else’s baby do this?

I do not let him sleep like this if I am going to sleep *