Newborn just wants mommy

Newborn only wants to be held by mommy. He is fine if he’s laid down or in the swing and etc, but when it comes to anyone else holding him he cry’s. Anyone else going through this to?