No movement

Danica
I haven't felt very much movement at all my first baby I felt her around 18 weeks and on the outside about 21 weeks this is my second and I thought your suppose to feel them sooner? I'm 20 weeks and barely feel anything at all should I be worried??