Boyfriends past

anon
So my boyfriend has told me he hasn't had sex, he's said a few times he's only one other stuff and doesn't mention sex but I've heard from someone that he had sex with his ex and at a party we were all playing 'never have I ever' if you don't know the game well basically someone says something they haven't done and you drink if you have done it and someone said "never have I ever had sex" and the guy who asked giggled at my boyfriend and he smiled. It's kinda bothering me that I don't really know the truth. Should I ask him if he had sex with her? What do I do?