is my boyfriend being over the top?

Me and my boyfriend dont currently live together; we are in the process of finding a house so we each live with our parents. I stay over at his house some nights so he gets to bond with our daughter. I stayed at his last night and he had work toda, so he refused to help with any of the night feeds because he "had to be up early" but he still woke up, he just laid in bed and watched me do it all. Normally he would go make a bottle while i changed her nappy so by the time im done, the bottle is ready but instead i had to leave her screaming after being changed so i could go make a bottle and he just laid there. Because of this, i was extra tired this morning as she woke every hour or 2 during the night. When he went for work he told me to not fall asleep with her on my chest which was how i was laid. So he left and i cleared his side of the bed, which is against the wall, moved all pillows and just laid her on the matteress because she screamed going into her moses basket but fell right asleep on the bed. Shes only 3 weeks old she cant roll anywhere and i made sure it was safe for her. I wouldnt of done it if it was during the night, it was only so i could have a nap. He phoned his mum and asked her to check on me and obviously she said that baby was in the bed and he has gone crazy at me, swearing at me down the phone calling me names and telling me he cant trust me to make sure she is safe. Now im so upset.. am i wrong for what i done? or is he overreacting