BILs friend

My BIL has a friend my husband and I do not like around our kids and my husband equally dislikes around me. We have expressed this many times to my BIL but he continues to invite him to everything including things and my in laws house. We never do anything with my husband's family that doesn't include the friend. I'm going to bullet point why we don't trust him because the whole story is very long.

BILs friend has

-hit his mom more than once

-stole his mom's car and led the cops on a chase when the car was reported stolen

-pulled a gun out on police and was shot 7 times because he refused to drop the gun

-was kicked out of his grandma's house for hitting her more than once

-Was kicked out of his pastors house because he started behaving strangely toward his 13 year old daughter and was caught sniffing her panties

-was kicked out of a church members house for getting into a fist fight with them

-went to prison for making bomb threats to a pizza place that wouldn't higher him. When searching his apartment cops found the makings of an acid bomb and how to searches on his computer

- has been caught taking close up shot of breasts, butts, and crotch area of several women in our family.

-has been caught taking video of women in our family

-has been caught watching porn and not privately but right in the same room as all of us

-has folllwed me when I walked away to nurse my baby

-was caught sniffing my BILs wife's bra

My husband has talked to his brother about letting us know when hes going to be around he never does and even when we ask he won't tell us most of the time. We have decided to just start turning around when we see his car or leaving if he shows up. I know this is going to be turned into us over reacting but I'm just not sure how else to deal with this. We can't keep allowing this guy around our kids and my husband doesn't want him around me either. I told my husband I feel the only way to get our point across is to just put our food down and decide we are just not going to be around him no matter what. We know it's going to effect our kids more than anything having to leave when they'll be excited about being with everyone but we're at a lose here. Any advice or suggestions?