Second hand smoke?

Brittany • Our baby boy born July 2016 💙 Our angel baby was taken Oct 2018 💔 Our Rainbow baby girl born Aug 2019 🌈 Currently TTC 2022
Every couple weeks my husband and I go out with friends. Usually to a bar. They're not smoky bars, but smoking is allowed if someone wanted too. .I'm 5 weeks along. At what point would second hand smoke affect the baby if I was around smoking? ( I never leave smelling of smoke. And we're usually only in there for 1-2 hours. )