Now he thinks he’s all high and mighty

My ex and I originally broke up because he moved South of our city & I can’t do long distance. Recently, he’s been coming around a lot so we started talking again but over the few months we haven’t talked he has changed a lot. He looks down upon people who drink or smoke even though he used to smoke and drink back then. He told me I shouldn’t work at this taco stand outside a bar because I shouldn’t surround myself in that atmosphere with “those” people. He thinks I’m ungrateful & gets mad if he wants to hangout but I already have plans set for that day. I don’t know how to tell him I don’t want to continue talking after having sex just yesterday.. I feel like he’s gonna think I was using him or something