Husband not want to do activities with us?

Recently my husband has worked two jobs on Saturday’s and has missed out on a lot of holiday activities, family events and visits to the zoo/museum.

Today was the first day since August that he had time available until 5 pm. I was excited and asked him what he would like to do with me and the kids.

He said he did not have anything he wanted to do with us. So I asked what he had missed doing with us these past few months. He said that there was nothing he had missed. He said he is happy to just stay home and be in the same house as us. He does not enjoy going out and doing things with us.

This made me feel very bad and scared that he is really not interested in doing stuff with us. Am I interpreting this the wrong way? Do you understand what he is trying to say? Please explain your take on it. I have had him try to explain and it just sounds to me like he enjoys having us around but isn’t interested in being a part of what we do.

Edit

He has two - three days off a week. He only works two jobs on Saturdays for extra cash by delivering for Pizza Hut .