Pregnancy and sex

Is sex completely safe during pregnancy? My doctor said we shouldn’t worry, but I freak out whenever my husband approaches me! I’m 8 weeks pregnant