physical attraction

Do you think it's wrong if you are physically attracted to someone else while being married? Like when you meet another man, sparks fly and you just feel it and can't help it ??