Nightmares on OUR Street

Recently I've been having nightmares. I only know about them because my partner has caught me talking in my sleep, like I'm being attacked or raped...but I don't remember them. He has woke me from them a few times. He keeps saying they had better not be about him, but I can't remember any of them and I don't know who they are about. Yet I can tell it obviously upsets him thinking they are about him. I can't control my dreams - or my sleep talking. I can tell he's carrying some anger towards me about it...and I don't know how to fix that. What would you do?