My Fault

I've been dating this guy for about a month and we fight alot. It always seems to be my fault. Whenever I say the wrong thing or talk about something too much he's always mad at me. At this point maybe you're saying I should leave him but I don't want to. When we're together in person we're great together and never fight it's only over text and I can tell he really does love me I think he just is bipolar. I wanna stay but I also wanna leave, if I do leave he's threatened to commit suicide and he has a history of attempts. Please help!