Husband afraid of the baby

So my sister in law gave birth to a baby and every time we see the baby I hold him but my husband refuses saying he’s to little and he doesn’t want to hurt him on accident. I asked him what are you going to do when we have a baby he says wait until the baby is older to hold them 🙄He had no problem with my 2 year old niece and picks her up to play. When the baby was 1 he then was comfortable to hold him. He is not comfortable at all holding new borns or young baby’s. So now we are having a baby and I asked him about holding the baby when it’s born and he’s say we will see and he might have to wait until the baby is bigger and stronger and not so little. Has anyone else had this problem will he change his mind once the baby is here?