Any other 2nd, 3rd, 4th etc time moms feeling that this pregnancy is so much harder?

With my first, I just chilled. With this one and having a toddler around, I am constantly on the move, bending, carrying weight (my 2 year old), stretching in weird positions to play with her, etc. Could I be harming the baby by being so active and doing these things? Not active in terms of working out, just more so worried about the constant bending, kneeling, etc!