Coffee and breastfeeding?

I am so afraid to go back to drinking my morning cup of coffee and risk baby getting caffeine and ruining our great bedtime routine and streak of sleeping well at night! Any moms breastfeeding and having coffee? I know very little crosses into breastmilk but they also metabolize caffeine MUCH slower than adults so I really dont know