Sore nipples

My breast hurt on the side and my nipples are sore as well too. They’ve been hurting for 2 weeks now and I’m now 4/5 weeks pregnant. Is it possible for it to come and go?