laying on back

I'm 5 weeks and 3 days, I've been sleeping on my back bc it's still comfortable for me. I've heard this can hurt the baby. Is it true?