6 week old teething?

My son keeps drooling and chewing on his fingers and his tongue. And he has the tiniest fever. My mom said its because he’s teething, and I guess I had three teeth before I was 2 months, so she thinks hes gonna be like me. Anything I could do for him? He can’t really chew on any teething toys because he can’t even hold any toys