Trust and the phone?

So I always let my. Boyfriend see my phone even if I'm not watching him go through it or whatever. But when I am on his phone he gets super nervous and watches me go through it. Then I got mad and asked him why he does that and he said, " I just feel like you're going to take some things the wrong way."