my husband hurt me. now what?

so. my husband and I are an interracial couple (him being white and me black). We have a son together and are usually very happy. Today though we were sitting in the living room watching it snow outside and he says "Sorry i didnt say happy martin luther king day to you yesterday." and i looked at him and told him that its not a holiday that you say that to. after seeing he wasnt being serious and the smirk on his face i quickly realized that he was trying to be funny, which of course i took offense to. i simply got up and left the room to think the whole conversation over (because i didnt want to flip out for no reason). after analyzing the situation i realized that i had a right to be hurt because this isnt the first time that he has made comments about me being black. he obviously didnt care after we had numerous conversation on the subject before.

i told him how i felt when i came back into the room and of course he apologized, but for some reason i am still bothered by it. i havent spoke to him since and am not sure honestly how to get over it.