Pain during sex

Before I found out I was pregnant, I was diagnosed with severe endometriosis & a tilted uterus...so even before this pregnancy, sex was sometimes painful. My doctor said that my endo symptoms will stop while pregnant, so what is causing my discomfort during sex now that I’m pregnant? I have no abnormal cramping or pains before or after sex, just in the moment...I’m approximately 6 weeks prego and I don’t remember having this problem with my first pregnancy. Should I be worried?