Are there any other mamas in my position?

Anyone else's baby can't say more than 1 word? He's such a smart child and independent and gets his point a cross by crying or saying uh uh when he needs something. He points at stuff that he wants, he reaches for stuff and if he can't get it, he will come find me and take my hand to show me. But he just won't say the words. He only knows mama and dad. He can also say one and two or A and B but he doesn't anymore or he only does it when he feels like it. He will count with his fingers when you say 1,2,3's. He use to know more words when he was 15 months but it's going down instead of improving. Should I be worried?