How to take the bottle away ?

My 2.5 year old doesn’t want to be off the bottle . He drinks other liquids off regular cups but when he’s cranky or tired he wants a bottle . I’ve tried different sippy cups or milk in his big boy cups and doesn’t take it . He cries non stop ! I’ve tried the garlic of the nipple and nothing he’ll take it as long as he has his bottle in his hand..

Any suggestions or should I just let him cry it out?..