This is very tough

I had this male best friend for 6 years , we was in a relationship but he broke it off because he said he saw it was going to turn out bad and he didn’t want us ending on a bad note so he asked if we can remain friends and we did . Well he was there through the good and the bad . He’s the only friend period that came in my life and stayed. I can call him at 7am and he will answer and listen to me if I needed to talk . Now we don’t have any sexual dealings , I have had children since then and we keep in contact and see each other when we can . He’s really like my best friend . Now I have a boyfriend and I don’t want to cut him off because that will be wrong and he’s my only friend but I do feel like it would be wrong to remain friends knowing I have a bf and knowing we once use to have sex . But Idk what to do