Am I missing something ?

So, In middle and high school I had this friend. Although I might’ve had a crush I don’t ever think he did we were just good friends. Right as high school was ending ( he ended up kissing one of my friends it wasn’t that I thought they liked each other because this certain friend doesn’t like guys lol but it was the fact she knew I liked him and kissed him anyway ) we slowly stopped being friends. About a year or two after we graduated high school, I reconnected with this friend ( the guy I liked ) and although I did have a crush it was one of those things that I felt we were better friends.. especially after he kissed my friend. Anyways I started dating this guy, and a year or two after we graduated we reconnected. All was going well until this friend started to tell me to leave my boyfriend.. I told him no and we stopped talking. Was I wrong to cut him off? Because every so often I miss our friendship. Because we were super close. Am I missing something ?