What do I do??

Basically I used to be very sexual with my partner before I got pregnant, it was very easy for him to have sex when he wanted it that was, he stopped having sex with me for a couple of years before I got pregnant and we’d only have sex every few months so I was very shocked when I found out I was pregnant! And when I did give birth to our daughter he started being very aroused by me even if I was in my sweats with milk patches all over my clothes, and at first that was nice to be seen properly for the first time in 3 years but he started lacking in helping me with our daughter and around the house and he’s been like that more or less since she passed the newborn stage, and I think it started making me less attracted to him, because I’m no longer wanting sex and I try to put it off as long as possible until I realise he’s getting fed up so I give in, most of the time though its because I’m shattered because he went help out with our daughter. We’ve recently moved and I’m not the kind of person to notice or be attracted to other men while in a relationship but I’ve been thinking about my neighbour constantly and it’s been upsetting me because my partner is trying his best to change, we have been through so much together but he’s also put me through ALOT… but despite it all I love him more then anything and I don’t want to lose him but I think if he realises what is actually going off in my head that he will leave 😭