Pacifier addiction- need advice

So we let my son have his pacifier for longer than we probably should have. He’s 2, and he’s a pacifier addict. We noticed recently that he started to chew it instead of suck it, so we’ve been forced to take it away, since it became a choking hazard. That was about 5 or 6 days ago and it has been torture trying to get him to nap or sleep. Last night was the worst. We finally got him to sleep, but he woke up multiple times during the night and would scream for what seemed like hours, even while we were holding him and trying to soothe him. Any ideas on how we can help comfort him during this transition? We’ve tried all we can think of and nothing seems to work.