Confused

Why is my boyfriend afraid to tell me that he has only had sex with me? I knew he was a virgin the first time we had sex, I could tell. But when I've asked him, he won't give me an answer