Ex husband nonsense

I'm going to try to make my background story as short as possible. Sorry for the long post. My ex husband and I have an 8 almost 9 year old son together. We've been officially divorced since 2014, he remarried a month later after our divorce. Him and his new wife had a son together, who is now a little over 2. My sons father and I used to get along so well until he met his wife. She is literally so controlling(it would take me hours to explain). My sons father works for a union and his hours change periodically due to the jobs that he takes on, my hours are pretty steady. With my son being school aged, all I ask for is consistency for his sake. Prior to last year my sons father was seeing him every Tuesday(non sleepovers) and every other weekend. (He wouldn't go if he worked nights, why take time away from me if he wasn't there) About a year ago he took me back to court stating he wanted more time and he was working days. We agreed in court that he could have him Tuesday and Thursday's non sleepovers, every Friday night for a sleepover and than every other weekend. We agreed that he was supposed to be the one picking our son up from school not his wife and if she was too pick him up it was supposed to be an occasional thing and he was to let me know ahead of time. As for holidays we have always split the major ones and the little ones we've never followed anything. We also agreed to talk every Wednesday so my ex could be a little more involved in my sons every day life since he's never bothered showing for things like parent teacher conferences or anything to do with my son for school which he stated that he wanted more time to do these things. These phone calls only lasted a little bit of time before they quickly ended after court. Pretty soon after court my sons father went back to working nights and he was being picked him by his wife and not even seeing his father at all and his father wasn't following the court order. But I allowed this to go on because I didn't want to argue and I desperately want to get along with his wife even though she makes it impossible. Recently we've had some issues arise with insurance and a few other things to do with my son, I contacted him a few times to discuss these things and his wife texted me telling me I could only talk to my ex on Wednesday's per our court order and to contact him than and than only unless there was a serious emergency with my son. She went to state that her husband works hard to pay me child support so I should respect that and not contact him.

After that message things just completely went down hill. On the Fourth of July, my ex contacted me at 2 o'clock in the afternoon asking to having our son saying it was his holiday, mind you he never mentioned anything before. As it being a holiday my son, my boyfriend(of 5 almost 6 years) were at a bbq because I haven't heard from his dad. He threaten to call the cops saying it was a odd year and it was his holiday. I had to leave the BBQ to bring my son to his dads(which I only did because I didn't want bad blood). So since my sons father wants to follow the court agreement when it's convenient for him, I spoke with him last Wednesday(as apparently the only day we can talk) I stated that he needed to start following the court order and his wife was no longer able to pick up our son from school/camp unless I was informed. Since then he hasn't picked up our son Thursday, Friday or today(Tuesday) hasn't contacted me nothing. This is completely out of character for him. Both my mom and boyfriend think that he has something up his sleeve, but I didn't do anything wrong, he can't follow the court order when it works for him and him only. Should I take him back to court since he's not following the court order and he's completely not seen his son in a week bow and hasn't even communicated any of that with me. My son is also 8 and he's confused on why he's not seeing his dad. Advice please!! Sorry for the long post! Hope it makes sense, a lot of background.