Masturbation during sex

I've never really been big on masturbation in general. Only when I'm really horny and my boyfriend isn't around. We've been having sex for over a year, so I'm totally comfortable with him. But I still feel like it's weird if I masturbate during sex. He often forgets clit is where it's at, so I want to take matters into my own hands (so to speak) during sex. But my question is if it's weird?