Draining job

Have you ever worked at a job before that absolutely drains you? I’ve been at my new job for almost four months now. It pays really good but it has been so hard on me. I am so stuck in wondering if it’s hard because I’m learning the job or because I don’t like it. I’m not sure. It’s so much work all the time and I am just so stressed out every single day. I have anxiety and on the weekends I have anxiety thinking about the following week and all the work that comes with it. I don’t know what to do. I feel like such a loser and a quitter if I walk away, I’ve never given up on a job. I don’t know how to understand if I am feeling this way because it’s new or because I just don’t like it. Has anyone else had this same experience before?