Toddler ear infection ?

Im pretty sure my son may have an ear infection. Do you take your kids to the Dr every time or treat at home? Im a new mom and dont know if it requires an appt every time you suspect an ear infection?

He has no fever. Just extra fussy, waking up at night constantly crying. I dont think its teething.