Relationship & anxiety

Me & my SO have been together for a little over 2 years. My anxiety was good mostly all the time we've been dating, around july or so of last year my anxiety got bad again. We don't go out to eat anymore & it was something we used to do almost every weekend. Today he invited me to go eat & i kinda gave him excuses & he didn't really get the memo so i told him that it seemed like he forgot & he said that he didn't just didn't know if i felt okay to go or not & to forgive him that he'll wait until i feel more comfortable. After that message i didn't reply & just broke down. It hurts me so much that i feel like i can't fully be a girlfriend anymore like i used to. That i used to be the one to say "lets go here" "lets try this new dinner place" & now i just avoid everything. Even seeing him gets me anxious in an avoidance way. I sometimes feel like i should just break up with him until i get better. I feel so insecure about it, i don't feel enough. It crosses through my mind how he might be better off with his ex since i know he won't be limited to things like he is with me. He's told me that he won't leave me because of my anxiety but i know that one day he'll get tired of it.