Baby sleeps on his side

I swaddle him and lay him on his back but when I wake up to check on him he's on his side. I heard its recommended babies only sleep on their back. Should I be concerned or not since he does it by himself.