Not enough water...

Mary ★★★ • Follower of Christ! Mother & wife. Jeremiah 29:11
I'm having a hard time. I drank so much water before pregnancy but now that I am, it makes me feel very queasy. I'm down to 3-4 bottles a day and it's torture. I sit there and the feeling of it hitting my stomach makes me shiver. I've tried super ice cold water vs room temp and both are disgusting. 
At the same time, I know I'm dehydrated. I feel thirsty 24/7 and hot. I'm just so uncomfortable. 
Anyone else go through this in the beginning? I'm 12weeks. I feel horrible like I'm hurting my baby but I don't know what else to do :( 
Any suggestions?