Baby movement

24 weeks and still only feel my baby move just once a day, some days not at all! Should I be worried??