too sexual?

So last night me and my new Boyf of 4 days went out to drinks and crashed there. We were both very very drunk and I was quite horny. And my hand kept grazing his dick when he was asleep. But he was like passed out and I didn't realise. And he just confronted me saying this is too sexual! Is he right to say this? WE HAVE HAD SEX MULTIPLE TIMES B4