Tv and sleeping

So long story short, my fiancé is on a rotating shift, so most nights he has to stay up long after I go to sleep. He of course lays in the bed with me rubs on me and watches tv.... well this week he’s on midnights. I ask him TWICE if the tv is okay. I turn the volume down to 20 (I’m deaf in one ear so this is almost inaudible for me) and ask THREE more times if it’s okay. He tells me it’s fine and so I rub his back for him while he sleeps. Well he gets up to go to the midnight shift and says “that’s the worst sleep ever” I freak out thinking it was my coughing or moving a lot (that bothers him - I’m a wiggler) and he goes “no that damn tv” apparently I was suppose to read his mind when he was telling me it was okay to have it on when it really wasn’t okay. I of course got upset apologizing and he’s so mad when he said bye it took him a full minute to respond back after silence after I said be careful I love you...... he’s obviously mad at me. I really don’t know what to do! Was I wrong for watching tv even though he told me I could? Hell I’ll never watch tv in the bedroom again. But I don’t think it’s fair for him to do that to me anymore. Because I could go to sleep a little easier without guns blaring with whatever show he’s watching..... I’m just confused.