Movement

When should I be concerned the baby isn’t moving as much?

I’ve been laying here the past hour, drank a little decaf coffee, some pancakes felt two nudges, I got up and Drank some water felt like he moved a little and now nothing again ?