Will caffeine reduce fertility chances?

Nikki • Mommy of 1 and currently expecting #2 in February 2021. 🥰
I would really love to know if having caffeine will reduce fertility chances. I'm a coffee drinker and I drink one or two cups a day. My husband complains that I drink too much. I don't smoke or drink alcohol and I exercise almost everyday. My diet though is moderately healthy.  
We started trying this month and I don't want to risk any chances of getting pregnant. I'm 38 this year and it will be my first baby if I'm pregnant. 🤞🏻and I really want to get pregnant.