Do you let people smoke around your child?

People think I'm crazy because I ask them to leave or walk away with my child when someone is smoking even in the middle of a conversation asthma runs high on both sides of my sons genes and I don't want to take any chance of him getting it! Does anyone else have this problem or just me?