Breast soreness gone

I’m 7 weeks 2 days and for the past several days my breast soreness is gone. They are slightly sore at the end of the day when I take my bra off but it was really my only symptom. I called my OB and they said it really doesn’t mean anything but it’s making me very nervous