I don't want to tell him the truth

I told this guy I lost my virginity to that I've had had sex before. Should I tell him the truth? We aren't serious or anything, he's my fuck buddy. I honestly didn't tell him the truth when he asked bc guys seem to get weirded out and think you'll get attached or something . Should I tell him eventually or just keep it my little secret lmao