guy help

🎀💖
So there's this guy who've I known for a few years now and he dated my friend and my sister and a while ago we kissed and there's just such a connection between us and even he said something about it but I can't help but feel guilty about it, should I like end it? 
*The guy and my sister dated a few years ago for about a month*