Feeling used?

Sooo I’ve been talked to a guy for a couple months, and you really appreciate the time you have no matter what it has in store. But I don’t always have a drive to have sex all the time. Sometimes he’ll say stuff like “damn what’s the point of me even driving over here” when I don’t feel like being in the mood. Or he’ll say “you wanna sleep you, can sleep at your place” makes me feel like shit. Is that normal, or should he be more understanding, or am I over reacting?