I need advise and/or opinions

So I got married in August 29th 2015 & when  we got our first apartment together stuff started to collapse. I was going through his computer and found 3 pictures of a naked girl. I asked why he had them and he told me " I never gave you permission to go through my computer " I got so mad cuz he should of deleted that stuff before we even got married. So that week I told him to get rid of stuff from his past and he didn't do it. I asked him again and he finally did it. Fast forwarding to December 26th I was going through his phone and found her number there. I asked him why did he have her number and he said " I thought I deleted it" . Honestly I've been so depressed and I am 4 weeks pregnant. Idk I don't want to be here , I don't want to be near negativity and stuff like that.