Back sleeping


I know it's not recommended to sleep you your back the further along you are... when I goto sleep I fall asleep on my left side but when I wake up around 3 am to goto the bathroom I am flat on my back! I'm 29+4 weeks pregnant... can I be causing my baby any harm?