Dissatisfied with sex life but don’t know if I should leave

My boyfriend and I have been in a relationship for 2.5 years. I am 21 and he is 24. Things have been okay, but not amazing and our sex life is one of my biggest struggles in our relationship. We only get it on twice a month, maybe three times if I’m lucky. He’s a sweet guy, caring, and says he wants to be with me but I don’t really feel like there is a physical desire in our relationship. I always have to initiate and he doesn’t really try to get me off other than just by penetration. We’ve talked about it before and he says he just doesn’t feel like having sex in general. Is sexual dissatisfaction a real reason to potentially leave a relationship? Please let me know your thoughts and advice.