Am I raising my son too soft?

My brother child will always try to fight for fun. The moment I look away he gets headbutted and punched several times. My son is 8 years old and his cousin is 6. My son will not defend him self. I tell my son he can no longer play his cousin because he’s always getting hurt. My son insistence till he ends up in tears. My sister son is also the same way, and busted his lip today. My son doesn’t rough house and keeps his hands to himself. His cousins are always fighting each other. I’ve told my son to defend himself he is older and bigger. My son refuses to defend himself because they are smaller than him. But I’m tired of him getting hurt. Am I raising him too soft. He’s also a only child..

Any advice?

(It’s not normal fighting my nephews are in therapy for behavior) Also these are his only cousins.