Friends with someone you've slept with

Déja

Soo my boyfriend hates a friend of mine who I've been friends with for years because he and I slept together once a few weeks before my boyfriend and I met. It's killing me to just cut off this friendship because my boyfriend doesn't want me taking to him at all. Help