When should I stop cross fit?

I love my cross fit gym, but I know I will have to stop going at some point because it is very intense exersize. So far I am only 5 weeks 2 days along and I am still enjoying the classes. Any advise of when I need to stop and change to a more moderate excersize routine?