Cries when anyone else holds him

So, hubby, baby and I went out of town for two weeks and my 3-month old went through a big growth spurt. Now that we're home he cries when anyone besides me or my husband holds him, bathes him, etc. including his grandparents. Has anyone else's baby started doing this? Do you think it's just a phase or should I make more of an effort to socialize him with other people?