cheat or betrayal

So I thought I trusted my man. Maybe I'm just being spastic because I've been cheated on before but I've noticed him flipping his phone over like all the time and he holds away from me when checking it or he'll wait until I'm not right there. He takes it with him across the bar just to say 3 words to another person rather than leaving it sit in front of me. He didn't do this until he found out I knew his password but it shouldn't be a big deal because he knows mine and helps himself to mine all the time. What's up? Am I overreacting or is he shady? Like, I'm about to move hours away from home with my 5 yr old for this man because I trust him. Is this a bad move?