Is my goal weight too low?

I am 5'8 and 220 pounds.

I'm at the very beginning of my weight loss journey. I'm taking it slowly, my first goal weight is 200. My overall goal weigh is 160-165.

People keep telling me that 160 is too low:/ when I was 187 my family asked if I was doing drugs and told me I looked like a skeleton. 😕