Is tap water safe to drink while pregnant?

I’m about 6-7 weeks pregnant and I’ve been drinking tap water like crazy. Is tap water safe to drink while pregnant? I’ve been reading the chlorine and chemicals can cause miscarriage or birth defects.