I know the answer but just checking to make sure I'm not crazy...

My partner and I agreed that he would not take any out of state jobs a month before and after the baby's due date ( I was high risk and he is my only support). 
Everything was fine until 3weeks after baby is born he tells me he's going on a job that is out of state. This job is with an ex-girlfriend, who isn't paying him. I've discussed with him again and again how this is more a favor to a friend and needs to be postponed. He gets defensive and says it's his job, he doesn't have a normal 9-5, and it's a way to network/get his name out there. I'm all for that but not when you have a three week old baby and I'm still recovering. 
Well even knowing how I felt he still went to New York, on Mother's Day weekend at that. (He said he would be back on Mother's Day, which he was but by that time I didn't care) Did I mention it was also my first Mother's Day without my mom? (Passed away shortly after Mother's Day).
Since then things between us have been terrible, but I go back to what started it all, him going to New York. Was he in the wrong? Or was I limiting his work?