Should I be worried

So I'll be 23wks tomorrow and my baby's movement seems to have slowed down. I Feel him some times just not as much as I felt like I felt him all last week. I was told I really shouldn't worry until like 28wks but I'm kind of worried now. I have an apt Monday so I'll see him but I can't help but to think about it.