Sex...

I like sex, and when I first started having sex with my boyfriend whom I lost my virginity to it was great and I felt close to him. We've done lots of stuff and it's all great... But sometimes  I don't want to have sex because I feel like I'm missing out on time I'd like to spend talking to him and doing some other activity. He would never make me do anything, but I make him really horny and so he obviously wants to have sex when we're together. We always end up having sex and it's hard to stop myself though it is always my decision... it's just I wish we had more time together and I don't feel that sex is as valuable as other activities. I've already talked to him about this, and he always tells me we don't need to. So should I talk to him again about it? Or wait for the next time to NOT do it and feel guilty until then?