Help! Should I just leave?

I've been on and off with my boyfriend for 4 years this Feb. Mostly on, but last year just before Christmas we broke up and the breakup was for about 6 months. During that breakup we slept together once, I got pregnant and at first we didn't plan to get back together, just to co-parent. But he started asking to give us another go because he really wanted to be a proper family etc. So a couple months later we got back together. Everything has been great so far and I'm due to give birth next week. Obviously, during the break up he completely changed, started drinking, smoking weed and meeting loads of girls. I only slept with one other person during our break up. But of course it's irrelevant because we weren't together. However, I'm finding it hard to trust him now. He has definitely changed since getting back with me, he's with me most days, every time his friends ask him to go out drinking he refuses etc. But when he is out, which is maybe once or twice a week I can't stop wondering where he is and what he's doing. Part of it is because of all the girls he used to 'chill' with and meet when we weren't together and the fact that its with these friends that he used to meet them with, and part of it is because I know what his friends are like. He's told me how they're always meeting girls and asking him to go out drinking trying to encourage him. I just can't trust him when he's out with them its to the point I sit here and drive my self mad. I told him i dont see how we are going to work because i cant trust him when hes out and he told me he wouldnt go out with them anymore. But he has. Hes out right now. sometimes i think I'm being stupid and paranoid, and that he had the choice at the start to have all the girls he wanted even though we was having a baby, but he chose to get back with me to be a family so why would he cheat now? But I just can't help it. I hate when he's not here with me, my head doesn't stop going back and forth and I'm stressed and miserable. Is leaving the best thing to do?