Guests right after baby

This will be our first and my mom is planning on coming and helping for a week after I deliver, then his mom for a week. We just told his dad and he said “call me as soon as you go into labor”. I really don’t even like my father in law and there is no way I’m calling him and having him visit while I’m in labor/ bring home my newborn. All of our family lives hours away. What are your thoughts? How can we say no without sounding like complete assholes?

Edit: I realize this came off kind of nasty, I’m just super hormonal. I’m excited to see our moms and have them visit but his dad is just a lot of work and not the nicest person