I don't know what to think

So, my husband is getting really irritated and frustrated with me. I'm really not in the mood for any "adult time." I'm about 8 weeks along, and I've had the "all day pretty much every day" sickness for about 3 weeks now. If I'm not vomiting, I feel like vomiting. Add plenty of fatigue on top of all of it for good measure. Before the nausea hit, I was super nervous because of 2 previous miscarriages. So, what I'm wondering is this: is he justified in being irritated at me, or is it normal to not want anything now?