Premature baby’s actual age?

My baby was born 5 weeks earlier than his due date. What makes me thinking is that is my baby’s age count from the day he was born or his actual due date? I’ve heard from here and there that for prem babies, should start counting the day of their actual due date. Will my baby be slower than any other babies?