I need advice

So I’ve been with my boyfriend for 4 years . Never once cheated on him and is against cheating . I’ve always told him I don’t cheat , if I felt like I had to cheat then I’ll just break up with him or if I cheated I’ll tell him . but our relationship is not the best . He’s been in and out of jail our whole relationship . We have 2 kids so obviously I’m a single mom and have been every time he goes to jail . He doesn’t allow me to have male friends cause he feel like all they wanna do is have sex . So I started a new job about 4 months ago . There’s this dude that finally decided to speak to me and we clicked off rip . We was friends . Cool friends my boyfriend didn’t condone it but I was tired of the insecure shit so I told him I’m going to continue to talk to him rather he like it or not because we can have friends ! So he gave in and said okay cool . Well now I like the friend a lot . And not as friends . He says the same stuff my boyfriend says but idk why my heart warms when he say it . My boyfriend was right , this is why he don’t feel comfortable with male friends and he’s right . I’m not sure if I’m happy in the relationship, all we did was argue and him go to jail (he’s in jail now and we are only 20) I’ve been faithful our whole relationship until now . I didn’t have sex with the other dude or kids him or nothing just our convos are inappropriate. I’m so scared to tell my boyfriend and I’m scared to break up with him cause he loves me so much and he’s going to be extra heart broken especially I’m the only one he has while he’s in jail . I love him , I’m not sure if this is the millionth sign that we need to break up or if it’s just a hard time for us that we’ll get through . I’m willing to cut the dude off to save my relationship BUT we are so toxic that this might be my sign to be done . Idk