BODY COUNT

So after 5 years of marriage my husband decides last night around 3am to bring up the body count convo. We were talking about the perception of sex and dating in this day and society and we discussed how a persons body count doesn't attribute to their ability to be faithful....so here he goes. "Can I ask you something?" My gut sank because I knew where he was going. "What's your body count?" To which I responded I don't want to go through this tonight. (Note: We have had this conversation before prior to marriage, and also again while married because I remembered a few 1 night stands that I hadn't count) but 5 years later why do you want me to be thinking about who I have slept with from I was a teenager to now (I'm 31) I believe he got offended, we didn't talk much afterward just went to sleep. This morning everything seems fine but I still feel like it's lingering in the air like a smelly fart. What would you do HONESTLY?