Ttc struggles

So myself and my OH have been trying for a baby for almost two years now. We have an appointment next month with the hospital as we have finally been referred. But we’re both now losing interest in having sex. It’s starting to seem like a chore and doesn’t feel sexy knowing we are having sex just to basically make a baby. We don’t want to stop trying as we are both desperate to be parents but just wanting some advice and to see if we’re not alone in this. We have tried everything, tried going on all kinds of diets, exercising more, nothing is working. Everyone keeps telling me “stop trying and it will happen” or “your time will come be patient” and it’s really not helping hearing any of this. I lost a baby four years ago so I can’t help but feel heartbroken that we haven’t yet had our rainbow baby.