Sex drive

Should you leave your relationship if you don’t think you and your partner don’t have the same sex drive? I could do it once a week maybe once a month and would be fine but my bf pretty much always wants it and I feel like I’m rejecting him when I’m not “in the mood”