Boyfriend Masturbating While I’m Asleep Next To Him

My boyfriend and I have not been having sex at all lately. I’m the one always wanting to but he says he’s too tired or not in the mood. For the past couple of weeks he has been sneaking off to go masturbate to porn in our living room or bathroom and he freaks out anytime I walk in on him. I expressed how It kinda makes me upset that he rather jerk off than have sex with me.

For the past couple of days we both have gone to bed and I wake up to him jerking off under the covers. Since I’m a light sleeper it keeps me up. He does it for at least an hour or two every night.

Should I be worried? Is it normal for guys to do this??