Compliments

Is it a bad thing if someone compliments me and I don't like it because I feel that it isn't true. A guy called me pretty today and I didn't even pay him any attention. Am I crazy if I hate hearing the word pretty being said towards women.