Are they right about everything they’re saying?

Everyone (my friends & family) have been commenting on my relationship. I have children with my boyfriend, we have been living together for 7 years. We had a baby boy 2 months ago. My boyfriend and I haven’t had sex in about 4 months and lately we have been arguing a lot. Sometimes he curses me out, but he is always there for me emotionally, he’s a great father and he takes care of bills, but he stays out late and I think he has another woman but I can’t prove it. He will stay out until 2 or 3 am, sometimes 1am. I ask him to come home, but he says that he’s doing things and has the right to have “minimal time” to himself. It’s not everyday that he does this just to clarify, it ranges. Sometimes it’s 2-3 times a week, sometimes it’s only once a week. But he does do it. I may be over reacting, he does pay all the bills so he’s right, he does deserve time to himself but my friends keep commenting on it saying that it sounds like he’s cheating and that he’s tired of our relationship or that at the very least he is seeing someone else.

I try not to think this way, we have a 2 month old and other children together so I doubt he would just leave me with the kids. I’m almost certain he won’t leave me but I need opinions and advice from other moms or people who aren’t in my situation because maybe I’m being a bit biased? Does it seem he’s no longer interested in this relationship?