Young and infertile???

Im young and ive never used birth control other then condoms. Ive with my fiance for 5 years we want a baby. Since December we have had unprotected sex and nothing has happened. Im healthy there are no fertility issues in either of our family history and we did do the whole wait til ovulation but still nothing has happened. I know i can go to a doctor but i dont wanna make him feel as though his manhood is the problem or vice versa. Any suggestions???