caffeine intake small baby?

I forgot to discuss this at my last appointment. My baby is considered small at 10+1. I have reduced my coffee intake by 2 half cups a day since I knew I was pregnant. Am I messing with my baby?