Homeschooling

Has anyone homeschooled their children or plan to? Mine is only 5 months but I'm already thinking about it. I was homeschooled during high school, but I wonder if there's a downside to being homeschooled so young? I probably could only do it for a couple years, because once there starts to be letters in Math I'm out!