Walking too soon?

Is there such a thing as trying to walk/stand too soon? What about sitting? My little guy is almost 2 months old and really tries to sit but I'm worried about him hurting his little spine:(