Ex troubles.

My sons dad knew he had to pick my son up tomorrow. He shows up tonight and asks if he could take out son tonight. It was already 15 minutes before my son was getting ready to go to bed. My ex made my son cry, stopped by just to tease him when he knew he was going to pick him up tomorrow. Should I be upset about this?