Does this happen to anyone else?

So sometimes me and my fiance will be having sex and in the middle of sex I won't be wet anymore. He gets really upset and thinks it's because I'm not attracted to him but I am I love the damn man! Why does this happen to me? Are there any ways to fix it without using lube because I'm allergic to some lube.