Will you allow your baby or child to trick or treat?

My partner and I aren't sure if we want to allow trick or treating. There are so many crazies out there who DO have the potential to harm/poison children. We are considering just letting our son go door to door, and then giving away the candy afterwards- and buying him sweets ourselves. Or maybe just not trick or treating altogether, and instead, going to a pumpkin patch or little Halloween festival so that we still do something. Is this weird? Is anyone else a first time parent and feel this way? Thanks