2 years married and won't know what to do 😓

My husband and I have been married for over 2 years together for 9. We always talked about having a family in the future after getting married and mortgage etc. Before we got married I came off the pill was completely open about it and thought we were on the same page. Since then our sex life has completely gone, I mean literally like once every 6 months if I'm lucky. It's gotten to the point where I stopped initiating because he would push me away and I just felt completely useless. Lately I just feel like we're friends who live together and spend time together but there's no intimacy. I really want a baby and it seems that everyone around me is moving forwards and having babies, my teenage nephew has just had his 1st. When I met him for the first time and had cuddles my husband seemed so uninterested it really hurt me, later I tried to talk to him about the baby, aw isn't he cute and don't you think he's a good size etc and he just said 'I didn't really notice'. I know what most will say - sit down and talk about it see how he feels but honestly I've tried and now I'm getting to the point where I feel like he never wanted a family but maybe felt like he was trapped and went along with the wedding out of duty not because he loves me and wants a family. The worst thing is I also feel guilty because I've been getting attention from someone I work with who I have always had a crush on. It was always an innocent thing because I knew nothing could happen and never wanted it to, it started off as harmless flirting (he's also married and bit older). A few months ago we had a work do and got talking and became closer we've messaged a few times and joked about something happening, I've only ever been with my husband and never thought of being with anyone else but lately it has crossed my mind when I'm lonely and I feel lonely more and more lately. I don't want to do anything with this guy I see him more as a friend anyway and cheating isn't something I'd ever want to do, I love my husband but lately I can't help thinking I settled down too young and never really had the chance to see what other relationships would be like. I then feel more confused because I really do want a baby but obviously without having sex that won't happen and I don't just want sex to conceive I want it to feel close to my husband and to enjoy it. I'm so confused and have no one to talk to 😓😓