Is it just me?

Last night having a great meal little drunk and I said to my husband if we were to break up would you sleep with anyone else (I obviously know he would) his answer was it would take some time but yes of course now to me if he asked me that I would have made a joke and said of course not your my only one I feel really hurt because he's never said anything like that to me before am I being stupid please be honest haven't slept all night