Clitoral pain during oral (TMI maybe)

C
Okay so when my so & I are getting down, he starts off with playing down there with his fingers. It feels so good. And then he goes down on me & it feels good but kinda painful on my clit. He doesn't do it directly either. Idk if it's just cause I'm too sensitive or what? Because I've told him to not go that hard & it still kinda hurts. Any ideas on what might cause this? Sorry if tmi 😔