Is it just my crazy emotions or...?

We were at my in-laws and my FIL was in a really bad mood apparently and tried to physically grab something out of my hand and spoke to me very disrespectfully. I’m a very sensitive person and I’m 8 months pregnant and everything makes me cry so I just left. I was crying and upset and I didn’t want to say something I’d regret. I texted my husband to bring our daughter out to the car to me and said that I would like to take her home with me and not stay for dinner and invited him to come home with us. He 100% agreed his dad was out of line, but said it would be awkward if he didn’t stay for dinner and stayed. Am I out of line to wish he had come home with me? That maybe his pregnant wife needs him more at this moment? Or is it just my crazy hormonal emotions talking?