PLEASE COMMENT!!

My son has an appointment with the pediatrician tomorrow but right now I'm worried and looking for opinions. When my son was born he was breathing too fast and the doctors wouldn't let me feed him until his breathing calmed down. Now he's four days old and I notice there are still times where he breathes really fast, kind of like he's panting or maybe having trouble breathing. Is this normal for new born, any thoughts?