He slept with someone during our talking phase but says sex has to be really special for him. Would this make you suspicious?

I’ve been talking to the guy I’ve been serious with for the past 9 months. He says all the time that he’s pretty vanilla and who he shares sex with is really important. Aka - he doesn’t sleep around. Well, he admit that about 6 months ago he did sleep w someone and that was the last time he did it. Honestly, it’s none of my business what he did because we weren’t exclusive but it raises an eyebrow that he makes it really clear he’s not that type of guy (which I rlly believe). He’s also talked about how he slept with another girl while he broke up with his ex gf and that now she kinda stalks him and insists that he should date her. His history pretty much proves that he’s the type of guy he says he’s not? I called him out on how he gives me a bit too much information on his life and these are the types of things he shouldn’t share with me. Girls, how would you feel about it? There are days where I brush it off and really don’t care but then out of the blue I’ll get into a silly mood where I overthink things and it messes me up. I need to stop being my biggest enemy 😂