sex buddy

Is it wrong to have a sex buddy ? Like all you do when you hangout is fuck and nothing else you don't talk or anything and he gets a little mad when you ask him to put a condom on