Smoking while pregnant problems?

I just found out I’m pregnant! But we smoke at night and we are trying to figure out if smoking will hurt the baby? Im not liking the idea but maybe a puff every blue moon? Not when I’m later in my pregnancy though. Does anyone know if that hurts or does any damage to our baby? Any help we appreciate!