Seeing a guy who’s best friend is bi

I’ve been seeing this guy for a month and we have been talking all the time and have had sex multiple times. He ha this girl who he says is his best friend and she I guess has a bf but she’s bi. Well he has mentioned a few times about like hooking me and her up so he can watch just for fun. I’m not into it. But he says they only hang out every few weeks and it’s been twice now since we started hanging out. Well every time they hang out he never talks to me or responds and they drink together. He tells me all the time he doesn’t wanna get hurt and he wants to take things slow and stuff. So idk what to do. Should I leave him I have a 2 month old I’m not into that whole game play.