Should I break it off with him?

The other day me and my boyfriend was having a casual conversation when we started talking about attractive people. It was at this point he told me he thought I was average looking. He told me that he has only ever thought one girl was a 10/10 but he couldn't go for her because she was out of his league! This really hurt me and I feel so insecure now, do I stay with him?