Am I being unfair or...

I expect its normal for husbands to have nights out and beer with the boys. However I went out with my husband this evening and ended up walking home myself at 2am...he's still not home and I'm pretty dissapointed. I sat listening to drunk people all night. He's has a night out every weekend but never does anything remotely romantic with me. We have 2 kids and he works away when he's home he just wants to 'wind down'. I don't live anywhere near my family so am pretty much alone most weeks...Am I being too hard on him? As I do appreciate he works hard too..