Sore boobs gone at 5 weeks, anyone else?

When I first found out at 3 and a bit weeks my boobs were very heavy and sore and felt bigger than usual. This lasted until about 4 weeks, then seemed to swap to my nipples.

Now at 5 weeks my boobs aren't sore at all, are back at normal size and my nipples are only slightly tender to touch. Did anyone else experience this? I'm worried it's a bad sign and means my progesterone is dropping or something.