Sleeping on the side..

Is anyone having a hard time sleeping on one side instead of on your back? I wake up in the middle of the night and try to get back to my right or left side but sometimes it’s hard.. is it ok to sleep on your back?

I heard it’s safer to sleep on the right side but thinking that’s later on in the pregnancy?