Significant other bored of family life?

we always said we'd get married get a house and have kids. We dreamed of having a boy and a girl, if we got two girls we would try once more for a boy. Same if we had two boys, three is our limit though. So we have two girls currently TTC baby no 3. Just lately my partner always manages to not be around when he knows I'm ovulating, like he will purposely stay out with friends or stay up watching movies until I go to sleep. I asked him to tell me if he changed his mind about another baby, he says he can't wait for us to have another...

I've saved up a deposit for a new place to live as our current place is too small for us (he put no money in at all). Found a place the exact same amount we are currently paying with an extra bedroom and when I show him he's not interested. He changed the subject completely. He spends every bit of his free time with his friends and not his family. I know everyone needs there space but it's kind of ridiculous.

He also used to talk about how he wanted to get married, now if someone mentions marriage he says he doesn't see the point in it and he never wants to get married. He went a day out with people from work and I suggested me and the girls coming along and he said it was just for staff. That's fine. Then I find out that pretty much everyone else brought their significant others and kids along...

I can't in good conscience still TTC but I'm not even sure if we should stay together. It seems like he wants to break up but he wants me to do it so that he doesn't get any of the guilt