Am I the Only One?

I am one of those people who gets horny at night- late at night- but since my SO works all day once they hit the bed it’s lights out 😴. My wife has no problems with me masturbating BUT I feel so wrong doing It beside her while she is asleep, like I am doing something wrong, or sneaky. Does any one else feel this way??