My current boyfriend and I have been together for 5months

Quite often I wake up to feel his fingers in me or he’ll start groping me

I look over and his eyes are closed and he looks like he's asleep. I'll move his hand away and he'll move it back.

I've asked him about it and he apologized and said he can't control what he does in his sleep.

As someone who has been in an abusive relationship before this kinda raises a flag for me but I'm just not sure if it classifies as assault