Should I dump him

So I have being dating this guy now for about a year and during this period I have noticed that he will sometimes times he will call me babe, honey or my name. Sometimes he will be on the phone and someone will ask him who is with him and he will tell them his girlfriend or his friend. But I notice that whenever I express my emotion towards him he pulls away and one time I called him babe on a text that I sent him. He called me back and asked if I was trying to get him in trouble. He just confuses me and I am at a point in life where I want things straight forward. I cannot deal with uncertainty or undefined relationship. Ladies I need your advice on this one please.