I hate my so’s friends

Hi despise my boyfriend‘s best friend. They’ve known each other for longer than I’ve known him. He does not respect women and he has said awful awful awful things about me. I know because I saw many text from him saying horrible things about me from the day my boyfriend and I started dating until now after we have a kid together and live together. My boyfriend knows I don’t like him but I put up with him because their friends. Thankfully for the first time he asked if it’s OK to invite him to a party tonight for his sister’s birthday. I told him I wasn’t excited about him coming but he could invite him if he wants because I don’t want him to feel like I’m controlling him and like he has freedom but just let me know if he’s coming so I can get mentally prepared. Only one minute later my boyfriend texted and said he’s not going to invite him.I’m really happy about that but I also don’t want him to feel like I’m controlling him and his friends because you know how men are they don’t like to feel like women are controlling them