Is this too controlling?

My bf and I are long distance.we have been fighting alot lately. So communication hasn't been good. He doesnt like the fact that I am going to the gym. Because there are other guys there. Should i stop going to make him happy. Or is he crossing a line?