Baby breathing hard

Hey guys. So my baby is a week old. He sorta sounds congested but hasn't had any boogers except a tiny one even when we use saline. He sometimes sounds labored and his chest/tummy goes up and down a little hard and fast. This doesn't happen all of the time, his color is still fine and he's not blue anywhere, but it still concerns me. We called the doctor and they said it's fine and to use saline drops but still no boogers come out. Do you guys think I'm over thinking this or it's a problem? Any tips?