Does the pill kill your sex drive?

I've been on the pill for 4 years now and the other day me and my bæ got into a fight because I was not getting wet at all, and he's convinced it's because I'm not sexually attracted to him which is not the case. This isn't the first time either which is what prompted the fight. I just want to know if other people find this a common problem and if there's anything I could do to help it. I considered coming off the pill but that's not very ideal considering I went on it for excessively heavy periods and I don't want that back. Any advice?