Upset when people give out phone number

Is your phone number private and does it upset you when people who have it give it out to others that don’t?

Additional info: I changed my number and only gave it to a select few. Apparently I didn’t set boundaries when I changed my number as some of my family I gave it to decided to give it out to whoever they wanted. How do I go about establishing these boundaries now so this stops happening?