5 years & a baby later

Hi all! My boyfriend and I have been together for 5 years. We have an almost 2 year old daughter together. He has never done me wrong in regards to like, cheating, & neither have I. Since we’ve had our baby, i feel like our relationship has started to fail. A bit of a backstory, in July, he went through my phone and saw I had received compliments from other people. I only ever said “thank you” and moved on. I’ve never met up with these people or have done anything else. Because i didn’t tell him about it, he questions my loyalty and says he doesn’t trust me. We’ve been bickering back and forth, this entire week. I finally asked if he wanted to talk, and we did. He told me he still doesn’t trust me and still questions my loyalty. I got some things off my chest too. Although i hate to admit, i have been thinking about leaving. I just didn’t feel we’d be able to work it out. Yesterday, when we talked, i asked him if he regretted getting me pregnant. Not our daughter, just simply the fact that he got me pregnant. Without hesitation, he said yes. I asked him if he was still with me for the sake of our daughter or if he actually wanted to be with me, and he told me 60% for our daughter and 40% because he actually wants to be with me. He told me he doesn’t love me as much as he used to, because of everything we’ve been through, but again, we’ve never done anything serious to each other. The only reason he told me he was still with me, aside from our daughters sake, was because i’m a good mom. Although, i took the compliment, that is the only thing he could think of — not all the help i pitch in with his business, not me balancing home/work life, not me cooking for him each day, not me doing his laundry. (To me these are all wifelt duties in a girlfriend position, but i was raised to cater to my man.) He told me he doesn’t belive in “Right person, Wrong time” and says if we take time apart we might as well end things for good. He told me if we split, he would want nothing to do with me, and would only converse with me about our daughter. & I don’t expect like a romance if we do split, but was hoping we could be civil “friends”/co-parents. We closed the comversation and went about the rest of the night as we normally would. But, this morning, i found myself thinking about what he said over and over. Could i please get some advice? Should i continue to try to work it out? Or should i go ahead and save myself the time by leaving?

I don’t know if it matters but i am 23 and he is 25.