Okay Chill?!

Im tired of my boyfriend telling me to chill. About everything even when Im calm and may sound stressed he just says "chill". I do suffer from anxiety and I stress a lot but when he tells me to chill I get really upset with him. How do I talk to him about it? I dont want my worrying to affect our relationship but Im getting so frustrated! I will apoligize for being late and he will just tell me to stop apoligizing and chill but I was raised in its polite. Any advice that doesnt include ending the relationship?