11week old doesn't sleep alone

My LO does not nap or sleep unless mom or dad are with him. He can be out cold, I'll try to sneak away, and he's up within 15 minutes. Does anyone have this? Any suggestions? I need to have *adult time* with my hubs.... Has not happened since baby! Help!!