Waking up to husband jerking off

So my husband and I do have a healthy sex life typically. Though, we just had a baby and with a 6month old now it’s difficult as we both work full time etc and life gets in the way. That said we do have sex 1-2 times per week. It would be more but he likes to stay up late and I’m just exhausted from the baby so I pack it in around 9. Instead of coming to bed he will stay up until like 11 then come to bed and try to have sex and I want no part of it. I’ve been sleeping for 2 hours already at this point. He did it last night and I rolled over and said no and went back to sleep. I woke up to him fondling my breast and jerking off. I was literally disgusted and yelled at him to get off. He got angry and went to sleep on the couch. Am I wrong??? Like wtf in what world is that normal.