Time to give up??

Rachael
My husband and I have been TTC for 4 years now. My insurance doesn't cover any fertility testing or treatment and I can't afford to go through it on my own. Can you just ask your regular doctor for clomid? 
Has anyone just gotten to the point where it hurts to much to keep trying? My husband says he feels bad every time I cry so I cry alone.