What should we do? My husband and I have been trying for our first baby for almost 3 years

My husband and I have been trying to get pregnant for almost 3 years.. We are 25 and we have saved over $20,000, but we are planning on buying our dream home in August and using most of the money for the down payment. I almost wonder if we should use most of the money for IVF because it seems like that will be our only chance at becoming parents and I guess we could always save it up again.. I am torn. I hate that we may have to compromise between two of our dreams when most people don't have to. I also hate that IVF is still not a guarantee at having a baby so if it doesn't work, we wouldn't have our baby or the money we spent. Insurance doesn't cover IVF in Texas. atleast mine doesn't. I'm just not sure what to do. advice? P.s I know I have to do IVF because I've seen fertility doctors already. Obviously, I've had all of the tests done. I have tubal factor infertility so IVF is our only option.