TTC 4+ years no hope

Me and my husband have been ttc for over 4 years now with no luck. Not even so much as a scare. Tried different positions, holding my legs up, having sex on every fertile day and still nothing. Not been to a doctor yet, mainly because I'm scared of the results we'll get. The only thing that scares me is even at a younger age neither of us ever any kind of pregnancy scare with other people either. Granted i was on the Depo shot for about 2 years back in the day. Still, scary thought that a happy loving couple may never conceive and have the joy of raising a family.