FTM will baby come early?

Ashley • Married August 23, 2013, Mommy to Hudson, Layne & Lenyn
I had my 35 week check up and my OBGYN said he definitely isn't going to be a 6lb baby. That scared me to death! I'm not a very big person so I fear having a huge baby. If he is big already will I go into labor sooner? My due date is Dec. 23. My anxiety has been through the roof!