When is enough enough?

Kelsie • I am 36 my husband is 38 and we are trying to convince out first child with low fertility chances on both sides.
When do you decide enough is enough and quit trying (ie. testing, measuring)?  My DH and I have been trying for our first for a year and a half. We saw a fertility specialist and they said that we should start looking into IVF but we can't afford it and our ins doesn't cover it. I was hoping more rigourous checking would help but now I'm ready to just say forget it and quit all of it. And if we get a BFP great. Thoughts?