masturbating

Do you get offended when your bf/gf masturbates? I've been with my bf for 7 years and I always get nervous or upset when I think about whether or not he does while I'm out of the house...I just don't like the idea of him looking at other women. .....is that wrong?