Boyfriends ex still in touch with his family

My boyfriend was with his ex for 3 years, then another for 9 months, and now he’s with me. His ex of 3 years still talks to his family and even goes on trips with them sometimes. There have been occasions where she got invited to HIS family vacation and he didn’t. Other times she gets invited and if she can’t go THEN he gets invited. He doesn’t keep in touch with her at all and I always hear from at least his sister and brother that she’s a pest and they aren’t the ones inviting her but it just bothers me that she is still in contact anyways. Talking here and there is one thing but still hanging out with the family is another thing. Am I being insecure or would anybody else be bothered by an ex still in touch with their significant others family??