Where does your baby sleep? Is this harmful?

Mine will only nurse to sleep and stay asleep if he is not moved. Hense sleeping with me, proped up on a pillow. (Avoiding reflux) or if he is in his fisher price swing. Is it harmful to his back to not lie flat on it? And always be proped up on pillows/at an incline?