no sex drive

I have lost my sex drive after having my baby 5 months. I'm always exhausted after a long day with my baby who is always fussing and has no routine. I'm never in the mood for sex. I still have sex with my partner 1-2 times a week and I can tell he wants more. I have talked to him about how rough my days are and that I want to relax in the 15 min alone time I get a day when baby is asleep. He still doesn't seem to understand and wants more sex. Now I literally avoid being alone with him bc I know exactly what will happen..!🙄