My boyfriend and the gym

Hey ladies,

So my boyfriend and I have been together for several years and recently I brought up the idea of us going to the gym together. He really does not want to go with me and after some nagging and repeatedly asking why, he says he doesn't want to have to worry about "taking care of me" or "going at my pace." Should I be as bothered as I am about it or take this "L" and let the argument go?

A ton of people I know go with their significant others and I don't know why he has such a negative view. I'm not a beginner and I just thought it would be good for us.