Essential oils

I've read many places that essential oils during the first trimester should be avoided!! But the place I work at keeps a diffuser running all day long!! Idk what to do because I am not telling anyone about the pregnancy yet, Does anyone know if essential oils are seriously harmful?