sex help?

so when me and my boyfriend have sex, it hurts a little deep in there. it's like a ball in there that hurts? idk what to call it, it feels rounded when i stuck my fingers in. it hurts when he presses against it but i figured how to get past it when i used a brush handle... (it took a long time though) but what am i hitting and is there a way to make it not hurt?