Sleeping on right or left side: does it matter?

I know you are not supposed to sleep on your back, and as you get further along sleeping on your stomach is a no go as well. But does it really matter if you sleep on your right or left side? I change positions multiple times a night to get comfy and I didn’t think it mattered. I’m only 7 weeks right now but is this something I need to be worried about right now?