he cares about me, but not that much

So yesterday my boyfriend and I finally had a discussion over something that had made me upset a couple days prior. (it took me a little bit to process my feelings and bring it back up). so long story short, we were joking nack and forth as we always do, then he said something that i took to be mean and it hurt my feelings. i didn't want to make a big deal about it bc it wasnt like it was catastrophic...but it still hurt. so i said something and he couldnt understand why i was upset bc he was "just joking" when he said it. Now cut to a couple days later and basically he apologized "that i took it the wrong way" saying that hes not actually sorry for hurting my feelings because he insists he was just joking. He doesnt believe he did anything wrong bc his intentions were not to hurt me, yada yada and so to him it wasnt a grievous enough offense to apologize for. So he didnt care to apologize about that. Im feeling like wtf...so he cares, but not that much?? i know that there are always 2 sides to every story and then there is the truth. sorry for the long post, but ladies i really need some insight on this. your thoughts?