Please advice needed!

My partner thinks it is unusual for me to visit my family once a week once we move out! I get 2 days off one of them is the same as my other half and the other is a day for me whilst he is at work. I have a very close family and he thinks it is so unusual. It has really made me upset and doubt my relationship with him as I wonder if he is getting this possessive now what will he be like once we do move out?