Causal Sex

Is it wrong to have Casual Sex with a married man, when he is ok with it!!