Help, I've started something I'll regret.

So I started letting my 6 week old fall asleep on my chest and I'd end up falling asleep with him. I wake up and go to lay him down, and as soon as I let go, he screams. he's gotten to where he will only sleep if someone is holding him. How can I break this before it gets to be too bad of a habit?