Balancing sex in a relationship?

My boyfriend and I have been dating for a while. We have sex frequently and I never worry. However his last relationship ended because their entire relationship was sex. My boyfriend has told me that we have a lot more in common than they did and sex is just a bonus. We openly talk about where we stand on this matter. But what are your opinions on this? How do you balance your relationship and sex?