Wanting dad to connect more- thoughts?

I have a wonderful husband, but im wanting him to be more caring, and protective of me during my pregnancy. last night I was feeling the baby kick hard, and pulled his hand over to feel my belly. He pulled his hand away and said it was uncomfortable, and kept watching the movie with his family. Im only 20 weeks, and he hasn't felt it before. When I felt the baby kick I started crying with joy but his whole family continued to watch the movie, uninterested. 
I went to the back room to cry. No one came to console me. I feel like I'm beginning this incredible journey in bonding with my child, and he's just living life as usual. Does anyone else feel this way? I know he wants to connect with me and the baby, but how?