Covid-19 and parenting

My fiance is taking this virus very serious. Which it is for sure, more and more stores, towns, schools, daycares are closing down. He read that a 2yr old child could have the virus, reporting that children and infants are also in danger as opposed to only seniors.

I'm a SAHM, haven't been out of the house this week, it's very lonely. So he says, he should stay away from both of us since he's out working and dealing with other people and lately he's being under the weather. No hugging, no kissing, no touching. I understand his concern but this could go on for months. And was upset and at first I said nothing, then I blurted out he might as well just not come home at all, in fact he should move out so he doesn't have to worry about it. So now he got angry at me and says I'm being irresponsible.

We are not visiting family anymore, I'm pretty much all day isolated alone with the baby and when he gets home he wants to stay away from us? I just don't get it, a part of me thinks he's using this as an excuse because he's really tired and stressed from work and doesn't want to deal with either of us.

I'm just really confused how to handle this situation now? I feel like a single parent with a check-in & check-out partner.