am i being to touchy?

so my husband i are having marriage trouble. and i want to fix it and i am trying. but i feel like he is not. so we have a 5 yr old son. and i am pregnant with our 2nd. so he told me he wants to spend more time with his friends. and i was like the whole weekend? ( cause he works the whole week and the weekend is when we get to see each other) and he said yeah. if you had friends you wouldn't care. and im like our marriage is falling apart and you want to spend more time apart? he said maybe thats why our marriage is falling apart is because we spend to much time together. is it just me or aren't you supposed to spend time together and try to fix the marriage? idk im pissed and he thinks that im being over dramatic and hormonal.