Treating me different when I'm not "pretty"

I'm the kid of girl who looks completely different with makeup...... It'll admit it takes effort to look "pretty"..... However on the weekends when I'm just staying home I don't wear any. My husband treats me like a different person! He picks fights, avoids me and is generally cranky whenever I'm not all made up..... But when I am he flirts with me, kisses, and pays attention to me!! I've brought this to his attention and he jokes it off! It drives me crazy!! I should be able to just be at home and not have to put on makeup and so my hair right????