Getting discouraged!

Hi ladies! I'm new to glow, but am glad I found it. I would like some insight from you guys because I'm getting a little discouraged. My husband and I have been trying for almost two years to conceive, so about three months ago I had a visit with my gynecologist and she prescribed for me letrozole. I was a little weary that it wouldn't work because it's typically designed for women that has problems ovulating, since that is not the case with me, I have regular periods every month, so obviously I'm ovulating. So for the first cycle my husband and I used the letrozole and of course as I expected I didn't become pregnant. So I got a little upset and just decided not to use the letrozole anymore. I'm just discouraged that I'll never have a baby, I'm 32 years old and never been pregnant. Is there anyone out there that has been through something similar as me?