Stressful Father. Advice Please!!

I am due to give birth to my daughter at the end of November. My pregnancy has been EXTREMELY stressful with my daughter's father & towards the end it has only gotten worse which gives me more than enough confidence after she's born, it is going to continue. We stay in different cities & when I have her, I am willing to let him stay the couple days I'm in the hospital. He wants to stay a couple weeks with me when I leave but I don't want him to come home with me because I dont want to bring home the tension or stressful environment for my newborn & I just want a break myself from the stress. I want to be able to enjoy my newborn since I haven't been able to enjoy my pregnancy. Are there ways I can keep him away? At least for a while so I can enjoy peace & a stress & tension free environment with my baby? Caring for a newborn is enough to handle right now, I don't want the added problems.