Coffee drinkers while ttc?

Michelle • 27 years old Wifey & Momma of a 3 year old. Currently expecting #2 in July 2015
So with my first son while ttc him I cut back all caffeine drinks and coffee. Idk if that played a part in how fast I concieved him. But with ttc #2 im still drinking a cup or two a day. I really don't wanna quit my Coffee but I worry caffeine doesn't help when ttc. What's ur opinions?