self-conflicted

Hey everyone, I have been with a man for a little, not too long, but I realize I don't think I want to continue on. He's not that bad, but I think between us we have different values in life nor does he really take care of himself. He is a nice and sweet man who loves me.

I'm self-conflicted because I'm not sure if my reasoning is good enough to leave. I don't want to break his heart, that's a big fear of mine. But I don't think this is what I truly want. Any advice? This is tearing me up.