Advice please

So my live in boyfriend last night (and twins father) stayed out until 5 am when I had called and texted that I was worried. Finally I had my sister come over and sit with my daughter so I could go and look for him. Found him and was angry because he flat out ignored me but it didn't really appear he had done anything else wrong other than falling asleep where he was at, when found though he did come home with me. Overall I had 3 1/2 hours of aleep so was exhausted today and more emotional than normal. Found out yesterday my 10 year old daughters father is going to prison for 3 years and today my first pet is dying and not doing well at all, as we speak she can't even walk so I'm taking her in in the morning to put her down, it was something that just happened today, pretty sudden(16 year old cat). I got in a fight today with my boyfriend (first real fight) and told him that all I wanted was an apology and all he said was he's sorry I felt the need to come and look for him and that he told me not to wait up, which is true but 5 am is beyond my boundaries, he had not been drinking and there was no girls there. I had been texting and calling since around 11pm because I normally hear from him. I thought he loved me but I've been upset and in tears all day over this fight, my daughter and my poor Callie and he hasn't hugged me or told me he loves me or anything all day, just one short peck on the lips at my moms and he caressed my face when we were picking up dinner. He has been snappy and short and now I am upset thinking he doesn't want to be with me. Someone please tell me it's hormones because I don't want to do this alone. I love him and all I want is support and maybe a hug and a genuine apology. We fought at noon and have never gone this long without resolving our issues. I'm so worried for our relationship and super hurt. I don't understand what is happening. Some advice please? Please don't judge but I'm 35 almost 36 and he is 26 almost 27, so far we've only been together since the middle of April and now I am 24+4 with twin boys, we found out mid July, so we got pregnant very quick, using protection, unplanned. We have always gotten along really up to this point but lately it's been a bit of a struggle. I had caught him doing whip its like a month ago which he stopped and texting those video chat girls from porn sites and talking about squirting and he stopped that too. Also our sex life has been somewhat struggling even though I want it more than ever (I went through his phone which was dumb, I know) I was only upset last night because there could have been an emergency, I honestly didn't care he had gone out. I YELLED at him today and feel like a jerk because he never raises his voice to me. Am I being the asshole or is it a combination?