Blankets

Does anybody use blankets for their babies to sleep with at this age? I've been one of those paranoid moms that refused to put a blanket anywhere near his crib (we've always used sleep sacks). He is now growing out of his sleep sacks because he is a big boy, wearing 12 months clothes and some 18 months as well. I'm considering blankets but so scared to try. I asked his doctor and she said as long as he is able to pull a blanket down from his face when I lay it on him, he should be ok to try...but I'm still scared. I guess I am looking for reassurances from other moms with babies mine's age...thanks!