Am I overreacting?

Today is my sons first birthday. Both my husband and I took the day off from work to spend as a family. The minute my son went to bed tonight he tells me he's going out with his friends. I felt hurt since, of all the days you decide to go out, it's today. He does this a lot. His rational is that if the baby is sleeping what difference does it make. It just makes me feel like he doesn't care about spending any time with me. I didn't say anything to him, just kept quiet so he instigated a fight and told me I bore him, I'm retarded, and it's my own fault he never wants to be here because I'm psycho. He struggles with depression and I understand that's a large part of his behavior but it's still really hurtful.