am i toxic?

my boyfriend drunkenly fingered a girl from our friendship group at the beginning of our relationship.

ive forgiven him and its been months since, but now i stop him from going to parties on his own sometimes in fear of the same thing happening.

i feel bad when i do it because i dont wanna stop his fun and i feel so clingy.. but also it makes me feel so unbelievably insecure.

we're very communicative so he knows that i still feel sad and hurt sometimes.

am i being controlling?