Can you give your baby frozen fruit?

Misha
I keep googling it and it keeps pulling up "Yes you can use frozen fruit for baby food." Which is not what I'm asking. Sorry if this is an obvious question. 
My baby is teething and LOVES ice. It's very scary to try and hold onto a cube of ice and it let it go into babies mouth due to choking hazard so I just puréed some fruit until liquid and put them into popsicle moulds. Is this safe? It has the stick so I won't lose it. And it's a thick mold so I'm not worried about big pieces falling off as I'll only let him suck on it for a few minutes.