Is sex better with someone you care about rather than someone you don’t care for?

So like what makes sex good?? I don’t know if I’m explaining my question correctly I hope y’all understand what I’m trying to say 😂😂

Backstory. My mans wants to have a threesome or swing. I said all I’m scared of is that he’ll find better pleasure with someone else and it’ll mess up my mentality. I’ll just constantly be insecure that I’m not pleasing him as much as she is. He said “honestly only sex with people you care about is much better.. ask anyone”

So back to my question.. is sex better when you have feelings towards the person? Or can sex be better with someone u don’t have feelings for rather than your actual partner?