Is it bad to sleep with a cold pack every night?

So I have really bad anxiety, ice packs are something that help me calm down, and I also get really hot because of my anxiety, so I've become dependant on sleeping with a cold pack somewhere near or on me every single night. I always wrap it in a blanket and I toss and turn a lot in my sleep so it's never on me for long and it isn't too cold, but can this cause any damage do you think?? I tried looking it up but couldn't find any clear answers