Husband is packing his things

I have a 6 month old and two teens and for 3 days straight he gets bothered for small things that I get annoyed with. He even packed up at 4am because I said "you haven't been taking your meds?" In an annoyed voice. So he said "oh you gonna fight with me? I'm leaving!"and he went and started to pack 2 duffel bags. He stayed there till like 5:30 then went back to bed after saying he wanted to pack right wash the clothes and roll them so he can pack everything and not have to come back. This hurts but 3 days straight of hearing this over small things? I just think he's cheating. He confessed 2 days after Mother's Day that he cheated on me 14 yrs ago. And I found a book a few days before saying he wanted to have threesomes with me and a variety of girls, that if I loved him I would do it. That he deserved it. Right now I'm just thinking he's cheating or wants to explore so he is looking for every excuse to leave me so I can be "the one who MADE him go". He wants to explore and he wants to leave... it hurts because I'm raising 2 teenage and now I started all over with my precious daughter. They are all his by the way. I'm just letting him decide because I'm still here even after all this