Cigarette smoke

Ok, so I get worried when I am around smoke or stuck around smoke. Even though I am not a smoker, seems like every smoker comes by me. Even though it's a little smoke around, can't that effect the baby? I'm 12 wks 5 days and just want a healthy happy baby. Comments?