Am i wrong??

So me and my man are working on our relationship we are taking it slow but a few red flags. He wanted us to work twds the kissing and cuddling and of course sex, so i find myself at this point begging for a kiss or for us to have sex he says we are working to build that back up and we are working on trust. Ummm well 👀 we can work on us and still have some sort of affection so now im really questioning everything so while he was sleep i did go through his phone we kind of argued and now he feel i really dont trust him. We both have things to work on but to have to beg for affection it worries me .