Falling in love with my friends with benefits

I’m upset it’s happening because I don’t want to spoil anything and my rational side knows I don’t want or need a relationship by any means but I find myself thinking about him a lot.. should I end our relationship or try and distract myself from it?