Craving overload

I want ice cream all day everyday to the point where if I don't have it I get sick..I've had ice cream everyday for the past 4 days and I was wondering if that is bad for the baby? I only have a small cup not a whole gallon but it adds up..And my doctor says I can't eat portions like I use too they can be harmful to a growing fetus..Is it too much?