I'm confused

I always finger my boyfriends asshole , he loves loves loves it !! he got mad one day when I didn't do it what should I do