Boyfriend

Hi, my boyfriend and I have a 1 year old and she’s our world. But she’s always with me and never with him. He has really bad anxiety which turns in you anger. He gets mad at me when the laundry isn’t folded and dishes arent clean. But i work at a bank (which has been very stressful with covid and our bank changing everything) plus always having the (very clingy) baby with me on my days off. What do I do? He has been taking CBD (no thc) to help him chill out. But am I in the wrong?