Noisy Neighbors

How do you deal with noisy neighbors after having a baby? The guy living above me is always out on his balcony talking on his phone. I can't even open my window. He is always doing laundry and the laundry room is right across from my apartment and he is, again, talking on his phone so my boyfriend and I can hear him through the door. Am I just being paranoid or should I do something about it? I don't want him to continue to wake up my baby when he is born.