Boyfriend masturbated after blow job

My boyfriend and I were making out and it led to me blowing him off. Well things were going great and he was about to cum, and I pushed his dick back like from the back of my throats I he doesn't shove it in my throats and make me not breath while he cums. So I did that and he looked at me funny and then the moment was over. Like he just looked at me and said your done? And I said I don't know your yelling at me what I did wrong..so he gets up. And says I guess you are. And then goes to the bathroom minutes later. And wanks off in there and comes back like it's nothing....?!?!? He says it's his body and he wasn't going to go to bed with blue balls... like should I be mad? Cause I'm kinda upset .. and it's hard to explain wh