On and off clit feeling..

Okay so, when I use my bunny vibrator my clit is definitely stimulated. But when my man goes down on me, it’s like I feel it one second and I don’t feel it the next. Is my clit malfunctioning? Cause I know he’s in the right spot..I just don’t feel it all the time. Maybe my vagina just enjoys the roughness and he needs to be more rough? HELP!