Does your SO do this?

My SO makes me feel like I shouldn’t be allowed to go take a nap. We have a four month old son and I’m a SAHM. He works on average 6 hours a day 4-5 days a week and supports us. I always let him sleep in when the baby gets up at 4 am and I also take care of the baby all night. I’ve never asked him once to get up in the middle of the night to feed, change, or comfort the baby. He’s also tells me he’s never felt the need to because he knows I’ve got it under control. So the one day I telll him I’m going to go take a nap, he asks me to take the baby with me. When I said no, he got offended because he didn’t even “sleep in today” and we “got the same amount of sleep” so I shouldn’t need a nap!! I’m scared to tell him every time I need a break or nap because he constantly rubs it in my face that he’s the bread winner and I have all day to nap. Can a girl just a few hours go herself!!! Is anyone else going through what I’m going through??