Infertile Mormon

My husband and I have been trying for almost a year now to have our first child, but have not had any luck yet. I am turning 31 in May, he's almost 26. Do any of you struggle with pressure or feeling awkward for being the only married without children couple in the ward? I often feel very alone, surrounded by all these fertile women, arms full of babies and such. I feel like infertility is a taboo topic in LDS culture. No one talks about it, no one acknowledges it, but everyone wants to be up in your business asking why you haven't started a family yet.