Sudafed PE

So I'm 26 weeks pregnant and yesterday I accidently took Sudafed PE instead of plain sudafed for cough and sore throat and you are not supposed to take the PE kind while pregnant. Has anyone taken this by accident before and everything been okay?? I'm freaking out and cried all day yesterday about it. I called the doctor but the nurse on the phone didn't seem to care much.. She said "nothing you can do about it now.." And I said "Should I go to the ER or come into the office to get checked out..?" And she said "no she's fine just don't take it again" I'm still terrified though..