Was I wrong?

Okay so I went on my boyfriend’s phone with his permission to find photos of us together. We started dating late January 2017 and he broke up with his ex early January 2017. I went back to late February and found a ton of photos of them together. So I asked him about it because I was curious why he saved photos so long after they broke up. He said that he and his ex exchanged photos of them together around then for keepsakes. I get it. They were together for a long time and he wanted to remember the good parts of that chapter in his life. Still makes me feel icky and jealous and all that but I know that was a big part of his life and it’s fine if he wants to remember it I guess. My issue is that he didn’t tell me he was talking to his ex at all. We both agreed that contact with exes is a no go by the first week of our relationship. So after I heard his explanation I understood but wasn’t feeling affectionate so I told him that I didn’t want to kiss him passionately but I did kiss him a bit like a peck. He got frustrated with me. Was I right to not want to be affectionate with him?