coffee?

So I stopped drinking coffee when I found out I was pregnant. I don't drink soda either, only 1 on weekends. I'm about to hit my second trimester and I've heard it's a bit more safe to drink it in second than first trimester because the percentage of miscarrying is low. Is this true? And can I start  drinking it again once I hit my second trimester? My "coffee" is half a cup of coffee, half milk with a little bit of sugar. I get hyper fast so I don't need much coffee but I enjoy it and miss it lol..