Worried about lack of breast tenderness

I'm 5+3 right now. I found I was pregnant at 3+6. The reason I tested was because my nipples and breasts were tender and sore and heavy. That continued to get worse, but as of yesterday and today, they're not that sore anymore. My last pregnancy was a miscarriage, so everything is now making me nervous. Do you think this is normal or something to worry about? Has this happened to anyone else? I know eventually the tenderness goes away when the hormones level out, but I feel like 5w3d is way too early for it to be going away