Might ruin my relationship HELP!!

My ex-boyfriends mother calls/texts me so often it's ruining my recent relationship with my boyfrien . He gets so bugged out and mad due to the fact that she calls me all the time. We were really really close back then. Her 3year old girl calls me also he loves me but I can't have them to ruin what I have.  what do I do? My ex also messages me. They know I have a boyfriend. They don't understand sorry this is long 😒