MY BF HAS SMALL HANDS

Does anyone else loves having sex worth their man but hates it when he fingers you ??  Please tell me I'm not the only one, and I don't know how to tell him so I won't hurt his feelings