Headaches

Last night I got my first persistent headache since finding out I'm pregnant. It's lingering a bit even this morning. I wouldn't classify it as severe like the glow app (pre-pregnancy my headaches were worse by far), but it is constant and annoying. I'm scared to take anything, even Tylenol. Anyone else experiencing this? I just don't wanna freak out and think the worst is happening. I'm prayerful that everything is okay. It'd help to know if others are commonly experiencing headaches and taking Tylenol hasn't had an adverse effect on your baby. Thanks in advance!