Am I in the wrong?

So the last time my boyfriend and I had sex I got quite frustrated. I believe sex is such an intimate and loving connection between two people. Well soon as we finished having sex, he jumped up and ran over to his phone and started scrolling through it. He hadn't even taken the comdom off yet. He pulled out, cummed, and then ran over and started looking at his phone. I told him later on that what he did kind of upset me and he said I was crazy to believe so. 
Sometimes I feel like he's actually hiding something from me. He's always on my phone. He knows my password, even if I change it, he looks through everything. Yet if I even touch his phone he freaks out....
I'm just really needing some help from someone. Even just someone to talk to and get some advice. Anything helps! 
Thanks!