Should my money be mine?

So I've been job hunting for over two years and finally scored a part time position at a gas station. My husband is an impulsive buyer. He'll lecture me about buying groceries twice a week, then turn around and buy $200 worth of games and never play any of them. Or a $100 electric guitar that's been gathering dust for the last year. Or he eats fast food for every meal instead of my cooking. We are always broke so I never have the opportunity to buy new clothes or food half the time. I haven't bought myself anything over $20 in three years. But now that I have a job, he wants my paycheck to go to bills so his income can be used for whatever. I don't think that's fair because I know he'll spend it all before I get a chance to do anything with it. He would have money if he'd quit spending it on garbage. I want my paycheck to be mine. So I can finally start pampering myself just a little bit. For real, I bought a hairdryer with my credit card a week ago because I've been without it all this time and got desperate. Is it unreasonable to want my money to be only mine? Obviously if something happens I'll be more than happy to share but it's the only income that I can say I earned and I want to protect it so we can start saving money for emergencies. He thinks I'm being selfish.