Husband trouble

I am on my second marriage. I am currently 19 weeks pregnant. My husband has an anxiety problem which he takes medicine for. For the last two months he keeps saying he is going to go off the medicine which makes him a completely different person . I work full time and have 3 other children that are under 5. He keeps saying I neglect him and make him want to leave. I say go for it then. I have been on my own once and I can sure the hell do it all over again and raise another child. He is just so lazy he works full time but when it comes to helping with the kids he does nothing. He won’t make dinner or give baths or take the dog for a walk then gets mad when he pees on the floor. Am I just hormonal or have I literally fell out of love with my husband?