Feeling dumb

So I spend 3 hours trying to get my boyfriend turn on when he was sleeping. (I know it's kinda wrong but he done it to me so many times in his sleep) but I finally for him turned on and he was into it until I tried to put my hand down his pants, but when ever I try I end up pulling his hair and it hurts him. (He got pissed off and told me no even though he was turned on) does anyone else have this problem (I'm bi and he's the first guy I've been with