Husband leaving me

I just need to vent ... me & my husband are amazing together , we never argue & if we do it’s over something little that we made escalate. We are each other best friends. But last night , he was receiving a ft call from his brother , & I was in my bra but I answered the call for him bc he told me to. However at that moment in time I honestly truly forgot what I was wearing & where his phone was in my hand. Now he says I’m sneaky & he can’t trust me at all, that I’m not capable of being the wife or woman he needs. But I truly just didn’t realize what I was doing at the time I was doing it , honestly. I would never flirt or do anything with his brother or with any man period, my husband is my all. We had a baby, but then I had a miscarriage & he stuck by it with me, at a point in time I was homeless & he was all I had . In January im going into the military & he says that everything happens for a reason & my going to the military gives us a fresh start, but he promised me & swore to me he would be there when I come back , that he’s not going anywhere, that our love is forever, that I’m the only woman he wants. But he’s so quick & easy to give up on our love over some cleavage. I am so hurt & he’s left the house. I’ve apologized to him , I’ve cried to him , pleaded to him. The whole night while he was asleep I was awake silently crying next to him.. is he right for leaving me ? Do I deserve it?