Am I being selfish?

So before I started my period I wanted sex all the time for a few weeks and my boyfriend was very adamant about denying me. Then 5 days into my period (at this point I hadn't been wanted sex once since we did it the day before I started) and my boyfriend starts cuddling with me and has a hard on and won't stop poking me with it and turning me on and he tells me to let him rub it between my thighs. I say why can't we just have sex? He says because I'm on my period. We do it every single period, no matter the day. I say that it's at the end and very light and that it was unfair of him to turn me on like that and deny me. Then he says never mind then and continues poking me with it and at this point I'm really irritated now. I tell him to get off (of me) so I could sleep because I have to work tomorrow. He says "that's what I was trying to do", meaning he was trying to get himself off. I tell him he's being selfish and he says that I'm being selfish for wanting to have sex instead of him just using me to get himself off. Am I really being selfish or is he being selfish?