lover, not a fighter.

i feel like the guy im dating is kinda weak. what i mean by that is im sure if there was an altercation of some kind he wouldn't stand up for me, defend me nor protect me. It really turns me off. he's a lover, not a fighter. Either way it irritates me that he's not more "manly" if that makes sense. Would you date someone who wouldn't defend you if nessecarry??? or am I being immature about the whole thing???