Mind is wondering

Hey ladies! So I was on birth control for about 4 years 2 on depo and 2 on ortho now it's 4 years later I still haven't gotten pregnant. My doctor said since I was still having regular periods I should be able to conceive but it hasn't happened yet and finance wise I'm not able to see a fertility doctor. My spouse says I shouldn't focus so hard just let it happen on it's own, but now I'm really getting frustrated especially since everyone around me is having kids