Am I childish?

Soooo me and my boyfriend have been dating for around 3 years. Today me and my bf were laying down and I told him I wanted a hug so I hugged him and he had his arm around me minutes later he took his arm away from me and I just moved away too. We were watching a movie and all of a sudden he asks why did you move back? And I said because you moved your hand I don’t think you wanted to hug and he started saying why don’t you communicate and started yelling at me. I have a past of not being able to talk because I feel scared to put out my feelings sometimes and we argued. A lot of times when I want hugs he will hug me for a little then let go and I’ve let him know so many times that it makes me feel sad when he does that but he did it again today and I’m tired of me constantly telling him for love and affection and he blames me for not asking for it. I don’t know what to do he calls me childish for that. Any advice ...?