Story time- title: In a bit of a struggle!

I've been with my boyfriend 3 years, and I know it sounds really bad but I am completely and utterly in love with my best friend (boy) and what makes it even worse is that my boyfriend and best friend are close friends (through me) at first I thought I could handle it, that it was just some feelings that would go away eventually but....it progressed, I started catching myself smiling thinking of him, wishing he was with me, texting him more often, feeling down when I hadn't heard from him, thinking of him while having sex with my boyfriend! And so on....I decided enough was enough, I ended it with my boyfriend and told my best friend how I felt, to my surprise he felt the same, I was over the moon! We started a relationship but on the down low, since it was pretty soon after my breakup, but then people started to talk and judge and I could see it killing my (ex)boyfriend to see us together all the time, it got too much so we called it off, he got together with some other girl and I got back together with my boyfriend, I regret it ever day calling it off with my best friend but i did what I thought was right at the time (well we both did) but even though we broke it off, those feelings have never gone away for my best friend if anything they have grew stronger! I really don't know what to do! In my head I think it's easier for everyone for me to stay with my boyfriend but I can't hide these feelings....I'm only human.