I don't know what to do anymore.

Alright so this has been something I've been dealing with for about 2 years now. I am with an amazing gorgeous man, and we have been together for 4 amazing years. The last two have been a bit of a struggle, I have had a lot of problems with my hormones making me have a slightly lower sex drive then I used to... and lately more so but I've seen it slow happening; he gets mad when I don't want to have sex... like he actually will ignore me until he's "cooled down" as he puts it... what do I do? I'm heart broken and terrified he's going to leave me for someone else because of this... he's my soulmate and I don't want to see him leave 😭