Am I in the wrong here..?? Confused.

Okay y'all my husband and I have been married over a year and a half now. We are very much still so much in love. I am. I love him beyond words that could even try to explain the very tip of it. He's very caring, hilarious, trustworthy, persevering and all that good stuff. However, when it comes to my family he is kinda iffy and doesn't wish for me to spend much time on them because he "misses me too much and doesn't wanna be away from me". He's got his own job working nightshift while I work a day shift. We see each other for only one full day on Sunday and I'm fine with that as I understand we have to work now to relax later in life.

What I'm getting at is, my sister who lives an hour and a half away from me asked me to go babysit because she didn't wanna take her kids to her mother in law's house as the kids there were always too rough and often bullied her kids, to the point of giving my 2 yr old niece a bloody nose TWICE. On the same day. And nothing was done about it by the other kids mother or their grandma. I'm sympathetic and since I am off on the day she requested, I accepted as she is also my sister and I haven't seen my nieces and nephews for a while. My husband on the other hand, is kinda not wanting me to go because he will "miss me too much" although when he gets home, he goes directly to sleep. I apologized to him for leaving him to go babysit but he would not accept it and was almost kinda furious with me..? I did miss him too but he kept going on about how I would leave him in a heartbeat to go babysit my nephews and nieces for a loner extended time. No matter how I denied it, he would not accept it and had concluded I would leave him without a thought. I WOULD NOT I ASSURE YOU.

Anyway, sorry for rambling on, please give me an advice you have and thanks in advance ❤️❤️