Coffee...

I love a cuppa coffee with milk every morning! Maybe 2 and 1 in the evening. I recently read caffein doesn't really help when one is trying to get pregnant. It relaxes the hair in the Fallopian tubes that are supposed to carry the sperm. I already have some from my husbands family blame my coffee drinking=delay in getting pregnant?? Any thoughts?