When to worry?

So I have anterior placenta, and I'm lucky to feel my baby move when I do. He doesn't move that much, mainly at night & sometimes not at all, all day. I'm 23 weeks pregnant  
My question is when should I start to worry if he isn't moving enough?????