Prenatal Vitamins

Might be a dumb question but I can't find the answer anywhere.
I'm 4 weeks and 6 days along, I'm about to make a doctors appointment and I was just wondering if I needed to be prescribed the vitamins or if I can just go pick them up at a drug store?