Is it time to leave?

I love my husband and I really do care for him but im not in love with him. Im not sure if I ever really was. I feel bad becuase I know he craves affection but I just can't give it to him in the way he wants. We met when I was 19 and in a really dark place in my life. He was in the middle of a divorce. We dated for 7 months then decided to get married. A week later we found that we were pregnant with our first child. We have been married now for 2 and a half years and have 2 children. I feel miserable. I have no clue how to be happy anymore. I don't blame my husband at all, I know it's my issues and problems that are to blame, but it is affecting our relationship to the point that I don't even want to be around him. What do I do?