Mamas with SO working 3rd shift

My boyfriend works 3rd shift 12 hours. 7pm-7am. Our baby is 2 weeks old, and every single time he goes to work, the baby stays up ALL night fighting with me, screaming crying. I feed him, change his diapers, try to cuddle with him and nothing soothes him. He does it every Monday and Tuesday and by Wednesday he finally gets adjusted and sleeps during the night. But we start it all over on Monday again. I'm pretty sure he can tell his daddy isn't home. Is there any way to get him to calm down when his daddy is at work? Or do I just need to tough it out? Did your baby do this? How did you get through it??