My fiancé is NEVER in the mood when I am

We only have sex every two weeks on Saturday. Literally it’s become like a schedule and I just want spontaneous sex, I don’t always want to follow a damn schedule. He says it’s best for his work schedule & that it makes us want each other more but that’s not true. I feel sexually frustrated and distant because of it (yes I’ve told him). It’s just not fair because if he ever does want to have sex when it’s not our routine (which has been maybe 3 times) I tell him okay but every time I ask him he rejects me. I just really want to feel wanted…every time he rejects me, it just makes me feel so insecure. I spent the weekend away with my family and I came back “wanting” him. I told him if he would be down to have sex and he literally told me “well if we do, it’s gonna be soft because I’m not in the mood right now.” I told him never mind. I just never feel that strong attraction from him to me like I do from me to him.