doctor wants to take me off work only 2 wks before

Johanna
Im currently 34 weeks 
And got all fmla papers to be ready everyone has been telking me its 4 weeks before your due date that you stop workin even at my jobs HR 
 But this doctor wants to take me off work only 2 weeks before
Its my first pregnancy and im here freaking out 
I know you go into labor before or after but
Im just paranoid cuz i work at the hospital and would not like to go from working to give birth
Should i worry? Or is it ok to still be working which  my job requires me to be standing the whole 8 hours even if im on light duty(restrictions from lifting heavy patients in a pca/cna)
What do you guys think?