I need advice please!!!

My son is 12 months and had his appointment yesterday. He is a picky eater or doesn't eat solids or pures much. Its a struggle for water or whole milk out of sippy cups/ straw cups. He does well with them but prefers a bottle. Well his doctor yesterday said ditch the formula that day and absolutely no more formula. Apparently he drinks to much formula and could cause anemia? I told the doctor he isn't eating enough or drinking whole milk enough to be satisfied or get the nutrients he needs. The doctor said "let him starve he will eat eventually"...... this doesn't feel right. I don't want to starve him. I tried today 10 times to get him to eat all sorts of food. I offer milk and water constantly and he will eat or drink a little but not much. What do I do?! I want to just give him whole milk in his bottle but everyone is telling me no hes a toddler now and just keep trying and that'll it'll be a rough few days but I'm not sure if that's right for my son. Advice please?