Need Advice about MIL

So me and my husband moved to a different state then where our family lives and my MIL came to live with us for 2 weeks before my due date and 2 weeks after the baby is born to help with my son and the new baby. She has only been here for one week and she doesn't really help me with my son and hasn't even token him to school yet. Today we had an argument about something so small and stupid and made me cry. I now don't feel comfortable in my own house. My husband has told her serval times not to stress me out and she does whatever she wants. So should I tell my MIL that she has to leave and hire a nanny for just when I'm in labor?