Toddler sick with newborn

My husband is mad at me because im taking care of my toddler who has a cold and fever and i told him i dont want our 1 month old to catch it too so he needs to watch the baby. He is mad because he needs to sleep, he said. I tried giving him a fresh formula to give to our son this morning and he said just leave them both alone. Am i wrong for just staying with my toddler... as much as i would like to have two of me to watch both my children...and he can just sleep... i cant. 😭