Before due date??

Everyone keeps telling me i won't make it to my due date since I'm so small. I was 115lb before baby, went down to 96lb when I got pregnant and now at 36 weeks I'm only 124lb. My baby weighs 4lb 13oz aprox. And my doctor hasn't said anything about me going into early labor or anything it's just my husbands family that keeps saying that. Has anyone gone into labor on or after their due date being so small and a FTM?