Is it wrong of me to be like this?

I don’t care to see or spend time with my extended family. They haven’t done anything to me. Over the years I’ve seen them less and less due to me living in another state. Now that I’m back in the city where my family resides I think there’s an expectation for me to reach out to my family more, and I haven’t. Whenever my mom brings up linking with my family members I get annoyed. There are times where I spontaneously reach out or spend time with them but there could be months to a year before that happens again. It’s been brought to my attention that some family members are offended that I’m so to myself, especially since I have a child. I don’t mean to offend anyone but I believe I should be able to live my life without worrying if I’m offending people.