Questioning Everything and scared I waited too long

I'm almost 40, my husband and I have been "sort of tcc" for about 6 months. We are hit or miss on timing, we are not having much sex due to tons of stress and pressures in our lives right now. 
​Should I go to a fertility doc since I am almost 40?
​I'm just so scared that we waited too long.
​This is so much harder than I thought it would be-I'm so confused about all of this new info, and I just feel really bad and alone. My husband definitely just doesn't get much of it and doesn't understand how important all the moving parts have to fit and happen at the same time we need to be having SEX!
​Any advice greatly appreciated!