coffee and conception

I have read several articles that say more than than one 8 oz cup of coffee per day can be detrimental if you are trying to conceive. I typically drink around four cups a day. The last year and a half we haven't been trying or preventing. As in, no protection but we haven't kept track of ovulation at all or tried to have sex like crazy during my fertile weeks. Nonetheless, nothing has happened and this will be our second month of *really* trying.

SO I am going to do a little experiment and drink only decaf coffee and see what happens. Anyone successful in conceiving after giving up regular coffee??