Stubborn baby

My son only wants to be held by me for naps, feedings, and just in general. Every time it’s my husbands turn to help out our baby cries non stop until it’s my “shift” again.

My husbands annoyed because baby now dislikes to be with him and I’m exhausted because I can’t sleep or get anything done due to me holding the baby all the time.

How do we break this cycle? I can’t live like this.

Baby is 5 weeks old.