Is my marriage over ??

My husband tells me quite often that he is unhappy and need some alone time. But he only says this when we are not seeing eye to eye any other time he is soo in love . I guess this comes from me asking him to let me know where he is going before he leaves the house be he thinks I'm asking to much and it's just for safety reason you know .. I just really feel like marriage is over and it hasn't even really started! Should I fight for him to stay or let him go ??