Sleeping positions

So as of recently I have a little dilemma that is making me scratch my head.

When I go to sleep at night I sleep on my side. I don't have any extra pillows so I use a spare blanket & either wrap around it or pack it against my back. I have even slept on the edge of the bed with my back facing out (I have never fallen off the bed in my life so I have no issues doing that). My dilemma is in the middle of the night I will wake up & I will be laying on my back... with my hands behind my head. Every. Single. Night. Is there any way to remedy this? Thank you to any & all that reply!