Foods upsetting baby?

Does anyone think what I eat could be bothering baby? I cut out coffee and have been having decaf in the mornings and baby is soooo fussy every evening from like 7-12 until she finally lets herself fall asleep. I keep feeling guilty about eating anything caffeinated or with sugar in it and I strictly avoid it come the afternoon but I wonder if eating it in the morning matters?