I realize masterbating is natural but...

My husband has been lying to me about masterbating. He gets home from work an hour before me and takes matters into his own hands (literally) before I get home. I am willing and able to have sex and I love being intimate. By the time I get home he's uninterested because he's already has his. I can't help feeling unwanted. Am I crazy and is there anything I can do to "fix" this without being a nagging controlling wife?