Would incompatible sex drives be a deal breaker for you?

My fiancé has a WAY higher sex drive than I do. I’m regularly really self conscious about how low mine is (1 or 2 times a month), but otherwise I’m perfectly healthy so I think it’s just how it is. Last night we had a discussion about how the physical side of our relationship is really hard for him to accept, and he needs to figure out how to cope with that, briefly mentioning an open relationship. I told him he can do what he needs to do, but that doesn’t mean I’ll stick around for it (as in, I’m very not ok with being open). The part that really hurt was that he didn’t reassure me about staying together, he just said he’d let me know. So my question is, would really differing sex drives be a deal breaker in your relationship? Before this I was very happy and secure with my fiancé, but now I just feel naive and heartbroken. I feel like if he doesn’t already resent me, he’ll come to. I’m really just looking for advice. TIA

****ETA****

I’m honestly not trying to be unfair, I just honestly don’t know how to navigate this situation in a healthy way. My boyfriend before him was abusive and constantly manipulated/coerced me into having sex with him and raped me. I really just don’t know where the healthy middle ground is or where to find it. Somewhere between making more of an effort and forcing myself to be physical when I’m feeling sex-repulsed