Pain when I’m fingered

When my boyfriend fingers me it sometimes hurts so bad that i cry. Afterwards i have trouble walking for a solid day or two. I don’t know if he’s just aggressive or what it is, but should I be worried?