Should I be worried?

Well a few months ago I had a one night stand with a stranger when I was really drunk (he was completly sober). The next morning I called him and told him respectfully it was a mistake and that we should not see eachother again. I told him that I was not in my right mind after all that vodca. I told him I was sorry. He seemed very salty and mad but he left me alone. Now it has been months later and he has texted me again acting all mad. Should I be worried? He knows where I live. I dont think he would do anything to me but I really do not know him.