Coffee?

My husband and I are currently in our second month TTC. I know caffeine is a no-no in moderation while preggers, but what about when we're just trying? I understand that the first trimester is crucial in the development of the fetus. I take my prenatal vitamin religiously, have eliminated taking any and all medications (i.e. Ibuprofen, ect) that may be harmful, and get plenty of rest and eat healthy. A cup of coffee in the morning is my ONLY indulgence. I don't drink and I don't smoke. What are your thoughts on coffee while TTC? I have full intentions of eliminating it when I do get my BFP, but until then, should I really deprive myself of one cup of coffee in the morning???