Does anyone get irritated?

When your SO masturbate when your right next to them and your asleep. I don't know why but this makes me mad especially when I'm not completely passed out! Am I wrong? Does anyone else also get mad? 
😤😬Edited!!! So I confronted him and he said no multiple times but swear I know he was lying we kinda argued the next morning about it but I let it go because it's only been twice this happened and honestly our sex life is amazing! We have sex at least every day if not 4/7 days of the week. He realize and saw how hurt I was regardless of anything but I can never sleep well till I have his arms around me🙈 I'm crazy for him❤️😍 but we're still getting use to us being together as a couple/adults.