Possible ear infection?

I know this isn't really pregnancy related but I need advice please. 
My ear is hurting SO bad! Like I can't touch anywhere around it or lay on it  or yawn/stretch my mouth without it hurting. I could barely sleep because of the pain. 
I'm 36w and I've hardly taken any medications during my pregnancy other than Tylenol. 
Would Tylenol help the pain or should I go to the ER?