I hate this

So first off I was raised without celebrating any holidays and was taught they were evil. So I never really cared if I ever celebrated them or not. Well my husband was raised with all these holiday traditions and that was hard for me at first but we came to a common ground on what to do about it. I agreed to celebrate Christmas and thanksgiving and I even cooked a huge meal and had friends over and had a good time and wasn't negative about it at all. I agreed to getting a tree and decorating our house and doing some of his family traditions. Well the other day my friend had invited me to a Halloween party and said we had to have costumes, I got a little excited because this would be my first Halloween party and it would be fun to just dress up and get away from work and life for a bit. Well when I told my husband and showed him a costume I got that I was able to use a store credit for and didn't even have to pay for it he got all upset with me. He said he never wanted to celebrate that holiday and that he wasn't going to go with me and he started fighting with me. Now he is saying he has every right to be upset that I said we would go. I am a little hurt right now. :( Should I just listen to him and not go and return the costume or should I try to talk to him again?