L&D due to decreased fetal movement

How many times have you been to L&D due to the lack of fetal movement? I’ve been there twice due not feeling much movement and hate having to go. I get so worried when baby doesn’t move as much.