So, is envious of our son?!

I need help. My so has told me numerous of times that he is envious of our 11 month old son; he says that since he was born I do t show him any affection any more and its all about the baby. Now for a bit of a background: I now have 6 children, he's cheated(kissed) in the past yr and has been extremely verbally abusive. Any comments.