TMI sex things while sleeping!

My husband keeps waking me up in the middle of the night humping my ass and grabbing my boobs and sticking his fingers in me. I wouldn't mind if he wants to have sex but he's sleeping! Like completely eyes closed, doesn't remember in the morning. It gets annoying, it's every night multiple times a night. We have a 16 month old that doesn't sleep through the night completely and wakes up at the crack of dawn. I'm exhausted!

Has anyone experienced this before? How did you deal with it?