Worried about meds

I tend to have bad reactions to just about anything I take meds wise. Tried Letrozole and had such severe headaches and even chest pain and had to come off of it. I even struggled on progesterone. I feel like a lost cause.

I’m supposed to start with a low dose of clomid this week on days 5-9 of my cycle and I’m terrified. Anyone relate or have some encouraging words?