Idk how to feel about this! :/

I have anxiety (only around certain things) the doctor gave me Xanax for anxiety but I DON'T take them at all n I just don't want to! Now the doctor wants me to see a counselor and talk about it & what could trigger it but I just don't have the want nor the energy in my busy life to go sit down with someone who obviously probably won't help me I went to a counselor before and that was a waste of time and money and Wasn't any help!!! I havnt had any anxiety lately and it's been good I been calm the past couple of months.... my SO helps to calm me down n everything I feel good ugh idk I'm scared to go n it be a was of time and money I might just go once or twice to shut the doctor up n call it a day I don't like talking to people about my issues when I'm fine opinions *please be mindful and kind with the comments*