Holding on

When do you know it's time to give up? My boyfriend won't have sex with me because he's "to tired". He drinks most weekends except for last when he was broke. He got paid today, guess where he is? At the bar. I've tried talking to him. I've tried giving him space and let him do his own thing. I don't want to lose him but I'm afraid it's coming to that.