Do you give money to people who stand outside stores asking for money?

I remember one time I went to the dollar store and there was a guy standing outside and he was asking for money politely, but I never have any cash on me, and I am always paranoid that they're going to rob me or something, so I said "No, sorry!". And walked past him. He asked me again as I left the store. My next stop was the liquor store across the street, and I couldn't believe it, but he was standing outside that store when I left too! He was like: "I saw you at the other store; you had no money then, but you have money for booze?" He said it in a really threatening way. I don't think that I should have to feel scared like that!😖