Is it wrong for me to ask my boyfriend to stop going to this coffee shop

My boyfriend likes to go to this coffee shop to read. That's actually how I met him because I would see him there a lot. He likes the atmosphere and their food. Since it's sports season now the cheerleaders from the university are coming in their shirt skirts and shirts showing their belly and hanging out at that coffee shop. I told my boyfriend I don't feel comfortable with him going anymore and he can just read at home. He says I'm being crazy and he's been going there since before we were together.