Boobs

Is it okay if I sleep with like a bandeau that has padding in it? Because I've heard if you sleep with a bra on it can make your boobs saggy.