Bringing somebody to visit

My boyfriend and I are broken up, and we are figuring out visitation for our son. He is 6 months old, and when he took him for his first night away, my son was extremely stressed out, and didn't go to sleep until 1 am when he usually goes to sleep at 7pm. He is visiting him over my house a few times before he takes him for an overnight, and he said he's bringing someone with him. He's done this everytime he's seen me since we've broken up. It's like he needs a bodyguard even though I've never laid a finger on him 🙄 I feel annoyed that he can't come and visit without the added theatrics... What do you think.