Am I the only one?

So my husband likes to finger me before sex because he likes when I’m really wet, but whenever he asks to finger me my immediate reaction is no. Like sometimes I feel weird or gross and I don’t want him down there, until we’re in the moment and I realize how good it feels. But why is my first response always like nahhh that’s okay...is that weird?