Teething HELP

I feel like I post a lot lately, sorry lol but I’m a FTM and y’all have been a big help! My daughter is just about 4 months old, and I’m wondering is she’s teething... her hands are constantly in her mouth, she’s grabbing and putting stuff in her mouth, she’s drooling and sometimes she cries and whines until she really starts chewing on her fingers. She has even started to chew on the bottle nipple when she eats. Last month at her doctors appt, her pediatrician noted she’s showing signs of teething. Can I freeze formula and give it to her like a popsicle? What have y’all done to help sooth their gums?