do I leave him?

I live with my boyfriend and we have a six month old baby boy. He never call me when my son has doctor appointments and he never answer my texts messages. He call his ex wife everyday. He do not give me money to help me with my son and only buy pampers. He go out with my mother in law everyday after work and we never had dinner together. He only pay the rents. Sometimes I feel lonely and I don't have his support. I have talked with him but he always blame me for no reason when is also his fault. Anyone in same situation? Should I leave him?