5month old not rolling over.

I had my baby at 36 weeks, not sure if that had anything to do with it, but he can’t roll over, or sit up, he barely learned to grab toys my sisters baby is 6months and he can roll over sit on his own and grab anything even his feet, he can even jump in a door hanging thing, if I put my son he starts crying and even when he does tummy time he cry’s and cry’s and gives up way to fast of course I feel bad and pick him up. I asked the doctor and he said my son is just being lazy. :( I just get sad cause I really do feel like he may be a little behind because he was born at that time.