Should I tell my bf that I feel uncomfortable. Should I even be in this relationship?

We went to our first party as a couple and there was a cute girl who also came in. I noticed he kept on looking at her the whole time and would try to talk to her. It's the type of look that i got from this one guy at the same party that was super attracted to me, until I made it known that i was there with my boyfriend by holding my bf's hand. My bf didn't do the same for me when he kept on looking and talking to this girl.

When I talked to my bf after the party, he told me without me saying anything about it that he was trying to make small talk with the women at the party so that it wouldn't be awkward. But in the back of my head, he kept on being drawn to this one girl at the party.

Is this something I should bring up to him? Do I even give him another chance, or should I just leave?