Coffee

So I was a big coffee drinker before pregnancy I couldn't go a day without coffee. My first trimester really helped me cut down since I couldn't keep anything down and all I wanted was water. Beginning of second trimester I started craving it again and I would ignore it. Well I just caved because I really want it, so I get a small 14 Oz or 16oz coffee and I've only done this probably 5 times. I haven't drank much coffee, I usually get a large coffee before I was pregnant. And I didn't really drink soda much until 4 weeks ago I only drink it when I need the sugar to be able to stay awake at work and drive home at 10 at night. (trained my body to crash at 8) I'm 27 weeks pregnant. And my sister just told me I ruined my babies chances of being healthy. My doctor said she healthy and perfectly normal everything is showing up great and obviously I believe him and I tell him how much soda and coffee I've had in the four weeks since I've seen him, he doesn't act concerned ever! I know some sugar intake is fine. I had a friend who drank coffee her whole pregnancy and her little boy is perfectly normal. He's 3 months old exept hes just a grumpy guy. Should I really try to stop with the coffee? I haven't drank any coffee for two and a half weeks and the cravings for it are now mild, last time I went to the coffee shop was to get hot chocolate. Opinions?