Help pls need advice

So my partner and I have been together 2.5years and we have a 1yr old year.. this sunday we have a music festival in town an were meant to be going, so we went to the shops the get some stuff to wear to it- at the shops i said something that he took the wrong way then he got grumpy and walked out and got in the car so we left and got our son from childcare an went home - on the way he got $$ out from our joint bank account and said hes not coming to the event on sunday and that tonight will be his night and he took his money and left. Now we cant afford for him to take $100 tonight and then also come to the festival on sunday so i told him he'd better be sure as he will be watching our son on sunday while i go myself if hes leaving tonight. ( we were strecthing our budget going to the festival as it was, howeverhe agreed to go as an outing together) now hes gone drinking tonight i know he will still expect to go on sunday to the event! The amount of times he goes out and drinks an see his mates is alot more ive actually never done anything since having our son. I was really disappointed as i figured this was something we could do together so im abit hurt that he chose to go out tonight rather than go together on sunday.. he did say that he couldnt stay at home cos he was angry etc because of the disagreement we had.. however theres been plenty of times when hes pissed me off and said something stupid thats annoyed me and i didnt get the opportunity to run off from home and do what i pleased.. i understand everyone is different but once we have a disagreement hes never able to just get over it and stay home and be normal, hes always got to leave and come back hours later. I dunno i think its unfair as he gets the time to himself to think and im left at home with a baby to care for so i dont really get the time alone to think etc...