Is this disrespectful

So stupid question, is it considered disrespectful to say excuse me to someone while your on the phone with someone else or to say short sentences like goodbye or have a good night?

Short story of why I ask. First I was helping a coworker at the computer, and he called me to let me know what needed to be done when I got home. So I answered the phone and told her I got to go see you later (he first got upset by this and said you need to stop talking or I'm gonna hang up on you). now he was talking but I was carrying boxes in my hand to throw. I work in retail so the hallway to the clockout and compactor is really crowded from blackfriday crap so as he's talking I said a quick excuse me to get past a load of managers to be able to keep walking and he started telling me again that I needed to be quiet and some other words I don't remember but I told him he's acting like a jerk for yelling at me for saying goodbye and excuse me. And then he hangs up on me. So I'm 31 weeks pregnant he says it's my hormones and I'm overreacting and apologized for hanging up but he said I was the disrespectful one in his apology for putting other people before him. I feel hurt and a little controlled, by being yelled at for being polite to other people and hung up on for it. What do you think?

Sorry for the confusion I didn't explain , not my coworker it was my husband on the phone I was helping them and when I finished helping them I told them that my husband was calling I had to go then I answered the phone. I was headed to clockout and bailed so I answered the phone, because I knew I would be home late and he texted me and told me he had to update me on what needed to be done with the dogs when I got home one of our doggies hates the rain and refuses to go to the bathroom when it's raining.