13 weeks with headaches

I’ve been having a mild headache for like a week straight, it started in my right temple the next day it was my left temple then for the days after it was pretty much everywhere, I suffer from migraines but haven’t had them since right before I got my first BFP. This headache is driving me crazy! I’ve tried water, I’ve been taking extra strength Tylenol but really hate taking them too much because I’m scared that they’ll start making me have headaches. Should I be concerned? Any suggestions?