Are saggy boobs normal even when one has not had a child to breastfeed?

Many people talk bad about saggy boobs and call them ugly. When my boobs started getting bigger around 15, they started sagging. I am a 40 D, and they are far apart. I always feel like they are so ugly, and many people are making fun of saggy boobs when some people cannot help it.