I'm at a loss

Last night I went for a shower and my husband was watching our son (born Jan 7). My son cried the whole time; I was barely getting out when my husband walked into the bathroom and tried to pass off our son. I asked him to hold him a few more minutes so I could dry and put my pjs on. Next thing I know he puts our son down  on the bed and walked out of the room. 
I'm so upset; even today he has apologized to me and our son. But I can't help but feel bitter towards him. Is this my husband trying to adjust to being a dad? Will it get better for him? He says that whenever he holds our son he is either asleep or crying... 
I just don't know what to do or say to him