Am I wrong?

My SO and I have been together for 5.5 years, we had our first son last year and are expecting our second. In our entire relationship I have always made an effort in relation to his family, we see them damn near weekly sometimes multiple times a week. He's close to his family and we live close, thats fine, I put in the effort. I'm not as close to my family but I always see them around the holidays and try and see my Mother at least every other week. I invite him for visits with my mother and if I bring our son to see my grandparents I always extend the invitation and he always passes. I only ever really ask my SO to see my family on Thanksgiving and Christmas and push for these 2 days a year as it does mean alot to not only me but my family as well. First let me clarify, my SO works for himself and can take anytime off he wants and dies take time off frequently to be home. Last year he didn't come to Thanksgiving, he said he absolutely needed to work to make a deadline, ok that's fine. Well I came home early from Thanksgiving because I was sick (pregnant) and he was home. I had only been gone an hour and he was chilling playing CoD. We got into an argument about his so called deadline and he said he would make it up at Christmas, well I had my son 4 days before so we didn't go. The years before this there has always been an excuse or we go and he nags about when we are leaving. This year is my sons first holidays and I want us to go as a family. A couple weeks ago he started a job and said that he wouldnt be able to take a day of for 5 or 6 weeks and not make Thanksgiving. Then last week he took 2 days off simply to stay home and watch TV and play CoD. My aunt is a king for a head count so she can prepare for Thanksgiving so this morning I asked if he could take off even a half day to go. He threw a hit about how busy he is so I threw in his face that he just took a couple days off to sit on his ass. Of course I didnt get an answer as he simply left. I dont understand here, am I wrong for asking for 2 days out of the entire year for him to spend time with my family? I put in so much effort with his and he doesn't lift a finger. Its to the point where I hardly visit my family anymore since they are constantly asking where he is and when they will see him next. I'm getting so pissed. Especially because we find out the gender of our next baby the day before and everyone is so excited for us to announce if its a girl or a boy. I really don't want to do that alone and deal with the Where's(SO)? Why cant (SO) be here, its a holiday? I'm to the point where I want to put my foot down and say if he doesn't see my family Thanksgiving and Christmas then my son and I will not be seeing his. I want him to put a little effort into this, I'm asking for 2 days out of the year and I see his family all the damn time. I'm so frustrated!