What would you do?

Last night my boyfriend stayed out late so I was home with the baby. Which would've been okay but he left and didnt say anything to me, He didnt even let me know he was leaving. When he came home late I asked where he was and he said it didnt matter. whatever. I was in a bad mood then, he kept walking past me but he was rrally close and the second time he did it I kind of pushed past him, again I was upset, which doesnt excuse it, he turned around and pushed me pretty hard. He told me not to touch him so I just walked the other way, 10 minutes later I wanted to apologize so I went up to him (he was turned away from me) so I touched his arm to get his attention and he turned around and yelled at me not to touch him. Again later I went to apologize and barely touched him, he turned around ran up to me and kind of put his hand up and got nose to nose with me and yelled at me to stop touching him, I've never been scared of him but that time he really freaked me out, I thought he was going to hit me, he's a lot bigger too, 6'2, I'm 4'10. Ive never seen him like that, the way he walked towards me and yelled at me was scary. Later in bed I told him that he really freaked me out and he told me I should've stayed away from him, he yelled it and our 4 month old son was right there sleeping in his crib so I told him to stop yelling and he yelled again telling me to "leave him the fuck alone" I guess he was right, I should've just left him alone but I just wanted to apologize. Was it all my fault?